Lib.rs

› Science › Machine learning
#llama #cpp #bindings #sampler #low #cuda #level

sys llama-cpp-sys-4

Low Level Bindings to llama.cpp

Owned by Eugene Hauptmann.

1 unstable release

new 0.1.83 Oct 27, 2024

#738 in Machine learning

Download history 128/week @ 2024-10-27

128 downloads per month
Used in llama-cpp-4

MIT/Apache

5.5MB
113K SLoC

C++ 56K SLoC // 0.1% comments C 34K SLoC // 0.1% comments CUDA 8K SLoC // 0.0% comments Metal Shading Language 5.5K SLoC // 0.0% comments Python 3.5K SLoC // 0.1% comments Objective-C 3K SLoC // 0.0% comments GLSL 2.5K SLoC // 0.0% comments Rust 453 SLoC // 0.3% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support, including new Sampler API from llama-cpp.

See llama-cpp-4 for a safe API.

lib.rs:

See llama-cpp-4 for a documented and safe API.

Dependencies