#proxy #inference #optimization #compliant #open-api #llm #performance

app runesmith

OpenAPI compliant optimizing inference proxy for enhancing accuracy and performance of LLMs

1 unstable release

0.1.0 Sep 13, 2024

#37 in #compliant

AGPL-3.0-or-later

13KB

runesmith-rs

RuneSmith: OpenAPI compliant optimizing LLM inference proxy

No runtime deps