Lib.rs

› Science › Machine learning
#cpp #cpp-bindings #llama #cu-blas #low #level

sys llama-cpp-sys-2

Low Level Bindings to llama.cpp

by MarcusDunn, sepehr455 and 14 contributors

48 releases

new 0.1.51 Apr 25, 2024
0.1.50 Apr 21, 2024
0.1.45 Mar 27, 2024
0.1.34 Feb 29, 2024
0.1.22 Jan 30, 2024

#458 in Machine learning

Download history 28/week @ 2024-01-08 113/week @ 2024-01-15 163/week @ 2024-01-22 138/week @ 2024-01-29 38/week @ 2024-02-05 196/week @ 2024-02-12 246/week @ 2024-02-19 942/week @ 2024-02-26 514/week @ 2024-03-04 714/week @ 2024-03-11 323/week @ 2024-03-18 270/week @ 2024-03-25 440/week @ 2024-04-01 380/week @ 2024-04-08 145/week @ 2024-04-15 315/week @ 2024-04-22

1,292 downloads per month
Used in 2 crates (via llama-cpp-2)

MIT/Apache

3MB
62K SLoC

C 29K SLoC // 0.1% comments C++ 17K SLoC // 0.1% comments CUDA 8K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments Objective-C 2.5K SLoC // 0.0% comments Rust 290 SLoC // 0.0% comments

llama-cpp-sys

Raw bindings to llama.cpp with cublas support.

See llama-cpp-2 for a safe API.

lib.rs:

See llama-cpp-2 for a documented and safe API.

Dependencies

~0–2MB
~40K SLoC