#proxy #llm #logging #observability

app chronicle-api

The Chronicle LLM proxy packaged as an API

2 unstable releases

new 0.2.0 May 29, 2024
0.1.1 May 9, 2024

#1967 in Database interfaces

Download history 79/week @ 2024-05-03 43/week @ 2024-05-10 3/week @ 2024-05-17

125 downloads per month

Apache-2.0

215KB
5K SLoC

chronicle

Chronicle is a proxy for language model API calls which

  • Provides retries and optionally falls back to other providers on a failed call
  • Records each call in a database, and sends OpenTelemetry events
  • Lets you switch model provider APIs without changing your request format.
  • Comes with a drop-in fetch function that will redirect OpenAI SDK calls to Chronicle instead.
  • Comes in two versions:
    • A full-fledged server for production use that uses PostgreSQL
    • A lightweight server that logs to an SQLite database and can read configuration from disk.

See the roadmap for the current status and other notes.

Dependencies

~82MB
~1.5M SLoC