#language-model #llm #response #sdk #messages #adapter #conversation

llm-api-adapter

SDK for interacting with various Large Language Model (LLM) APIs

6 releases

new 0.2.1 Apr 27, 2024
0.2.0 Apr 25, 2024
0.1.3 Apr 21, 2024

#1813 in Web programming

Download history 250/week @ 2024-04-08 224/week @ 2024-04-15 365/week @ 2024-04-22

839 downloads per month

MIT license

17KB
241 lines

LLM API Adapter SDK for Rust

This product has been renamed to babel-bridge and is now maintained at babel-bridge

This is a Rust SDK for interacting with various Large Language Model (LLM) APIs, starting with the Anthropic API. It allows you to send messages and engage in conversations with language models.

Features

  • Send single messages to the Anthropic API and retrieve responses
  • Engage in multi-turn conversations with Anthropic's language models
  • Customize the model, max tokens, and temperature for each request
  • Handle API errors and parse responses using Rust structs
  • ...

Dependencies

~4–18MB
~239K SLoC