#language-model #llm #proxy #logging #observability #api-calls

app chronicle-api

The Chronicle LLM proxy packaged as an API

9 unstable releases (3 breaking)

new 0.4.3 Jul 9, 2024
0.4.2 Jul 1, 2024
0.4.0 Jun 29, 2024
0.3.2 Jun 24, 2024
0.1.1 May 9, 2024

#426 in Database interfaces

Download history 122/week @ 2024-05-09 2/week @ 2024-05-16 143/week @ 2024-05-23 248/week @ 2024-05-30 24/week @ 2024-06-06 7/week @ 2024-06-13 295/week @ 2024-06-20 507/week @ 2024-06-27

836 downloads per month

Apache-2.0

395KB
10K SLoC

chronicle

Chronicle is a proxy for language model API calls which

  • Provides retries and optionally falls back to other providers on a failed call
  • Records each call in a database, and sends OpenTelemetry events
  • Lets you switch model provider APIs without changing your request format.
  • Supports both SQLite and PostgreSQL databases
  • Comes with a drop-in fetch function that will redirect OpenAI SDK calls to Chronicle instead.
  • Supports logging "runs" and "steps" for multi-step workflows

See the roadmap for the current status and other notes.

Dependencies

~88MB
~1.5M SLoC