Lib.rs

›
#optimization #compliant #inference #open-api #llm #proxy #performance

app runesmith

OpenAPI compliant optimizing inference proxy for enhancing accuracy and performance of LLMs

Owned by da-moon.

1 unstable release

0.1.0 Sep 13, 2024

#33 in #compliant

Download history 162/week @ 2024-09-13

162 downloads per month

AGPL-3.0-or-later

13KB

runesmith-rs

RuneSmith: OpenAPI compliant optimizing LLM inference proxy

No runtime deps