Lib.rs

› Science › Machine learning
#inference #llm #llama

scaled-dot-product-attention

LLM inference in Rust

Owned by zhouhui.

1 unstable release

Uses new Rust 2024

0.1.0 Aug 1, 2025

#1762 in Machine learning

MIT license

21KB
111 lines

scaled-dot-product-attention

Dependencies

~12MB
~231K SLoC