#proxy #llm #logging #observability

yanked chronicle-local

The Chronicle LLM proxy API, built for local use with SQLite and configuration files

1 unstable release

0.1.1 May 9, 2024

#70 in #observability




Chronicle is a proxy for language model API calls which

  • Provides retries and optionally falls back to other providers on a failed call
  • Records each call in a database, and sends OpenTelemetry events
  • Lets you switch model provider APIs without changing your request format.
  • Comes with a drop-in fetch function that will redirect OpenAI SDK calls to Chronicle instead.
  • Comes in two versions:
    • A full-fledged server for production use that uses PostgreSQL
    • A lightweight server that logs to an SQLite database and can read configuration from disk.

See the roadmap for the current status and other notes.


~1.5M SLoC