#language-model #llm #response #sdk #messages #adapter #conversation

llm-api-adapter

SDK for interacting with various Large Language Model (LLM) APIs

6 releases

0.2.1 Apr 27, 2024
0.2.0 Apr 25, 2024
0.1.3 Apr 21, 2024

#1765 in Web programming

Download history 251/week @ 2024-04-09 266/week @ 2024-04-16 331/week @ 2024-04-23 20/week @ 2024-04-30

868 downloads per month

MIT license

17KB
241 lines

LLM API Adapter SDK for Rust

This product has been renamed to babel-bridge and is now maintained at babel-bridge

This is a Rust SDK for interacting with various Large Language Model (LLM) APIs, starting with the Anthropic API. It allows you to send messages and engage in conversations with language models.

Features

  • Send single messages to the Anthropic API and retrieve responses
  • Engage in multi-turn conversations with Anthropic's language models
  • Customize the model, max tokens, and temperature for each request
  • Handle API errors and parse responses using Rust structs
  • ...

Dependencies

~4–16MB
~227K SLoC