#proxy #llm #observability #logging #record

app chronicle-api

The Chronicle LLM proxy packaged as an API

3 releases (breaking)

0.3.0 Jun 2, 2024
0.2.0 May 29, 2024
0.1.1 May 9, 2024

#491 in Database interfaces

Download history 119/week @ 2024-05-06 4/week @ 2024-05-13 2/week @ 2024-05-20 365/week @ 2024-05-27 44/week @ 2024-06-03

422 downloads per month

Apache-2.0

275KB
6.5K SLoC

chronicle

Chronicle is a proxy for language model API calls which

  • Provides retries and optionally falls back to other providers on a failed call
  • Records each call in a database, and sends OpenTelemetry events
  • Lets you switch model provider APIs without changing your request format.
  • Supports both SQLite and PostgreSQL databases
  • Comes with a drop-in fetch function that will redirect OpenAI SDK calls to Chronicle instead.

See the roadmap for the current status and other notes.

Dependencies

~86MB
~1.5M SLoC