1 unstable release
Uses new Rust 2024
| new 0.4.3 | Mar 18, 2025 |
|---|
#577 in Asynchronous
7MB
14K
SLoC
The Easiest Rust Interface for Local LLMs
This a fork of llm_client.
Dependencies
~36–72MB
~1M SLoC
The Easiest Rust Interface for Local LLMs, and an Interface for Deterministic Signals from Probabilistic LLM Vibes
Uses new Rust 2024
| new 0.4.3 | Mar 18, 2025 |
|---|
#577 in Asynchronous
7MB
14K
SLoC
This a fork of llm_client.
~36–72MB
~1M SLoC