#inference #llm #llama

all-close

LLM inference in Rust

1 unstable release

Uses new Rust 2024

0.1.0 Aug 1, 2025

#1645 in Machine learning

27 downloads per month
Used in scaled-dot-product-attent…

MIT license

10KB
63 lines

all-close

Dependencies

~11MB
~225K SLoC