1 unstable release

0.1.0 Nov 30, 2023

#91 in #inference

Custom license and LGPL-3.0

17KB
255 lines


Types for a pure rust chat app using Axum Webhooks (multi-user), HuggingFace/Candle for LLM inference, and Leptos for a WASM frontend

Dependencies

~68MB
~1M SLoC