Lib.rs

› Science › Machine learning
#cpp #cpp-bindings #llama #cu-blas #level #low

sys llama-cpp-sys-2

Low Level Bindings to llama.cpp

by MarcusDunn, Sepehr and 14 contributors

49 releases

0.1.52 May 8, 2024
0.1.51 Apr 25, 2024
0.1.45 Mar 27, 2024
0.1.34 Feb 29, 2024
0.1.22 Jan 30, 2024

#436 in Machine learning

Download history 138/week @ 2024-01-29 38/week @ 2024-02-05 196/week @ 2024-02-12 246/week @ 2024-02-19 942/week @ 2024-02-26 514/week @ 2024-03-04 714/week @ 2024-03-11 323/week @ 2024-03-18 270/week @ 2024-03-25 440/week @ 2024-04-01 380/week @ 2024-04-08 145/week @ 2024-04-15 315/week @ 2024-04-22 43/week @ 2024-04-29 99/week @ 2024-05-06 15/week @ 2024-05-13

553 downloads per month
Used in 2 crates (via llama-cpp-2)

MIT/Apache

3.5MB
64K SLoC

C 29K SLoC // 0.1% comments C++ 18K SLoC // 0.1% comments CUDA 9K SLoC // 0.0% comments Metal Shading Language 5.5K SLoC // 0.0% comments Objective-C 2.5K SLoC // 0.0% comments Rust 290 SLoC // 0.0% comments

llama-cpp-sys

Raw bindings to llama.cpp with cublas support.

See llama-cpp-2 for a safe API.

lib.rs:

See llama-cpp-2 for a documented and safe API.

Dependencies

~0–2MB
~40K SLoC