Lib.rs

› Science › Machine learning
#cpp-bindings #low-level #llama #cuda #api

sys llama-cpp-sys-2

Low Level Bindings to llama.cpp

by MarcusDunn, Sepehr and 28 contributors

68 releases

new 0.1.83 Oct 29, 2024
0.1.69 Aug 30, 2024
0.1.64 Jul 26, 2024
0.1.45 Mar 27, 2024

#913 in Machine learning

Download history 252/week @ 2024-07-08 25/week @ 2024-07-15 173/week @ 2024-07-22 33/week @ 2024-07-29 126/week @ 2024-08-05 197/week @ 2024-08-12 363/week @ 2024-08-19 195/week @ 2024-08-26 29/week @ 2024-09-02 20/week @ 2024-09-09 153/week @ 2024-09-16 197/week @ 2024-09-23 63/week @ 2024-09-30 517/week @ 2024-10-07 368/week @ 2024-10-14 125/week @ 2024-10-21

1,079 downloads per month
Used in 6 crates (via llama-cpp-2)

MIT/Apache

5MB
105K SLoC

C++ 49K SLoC // 0.1% comments C 34K SLoC // 0.1% comments CUDA 7.5K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments Python 3K SLoC // 0.1% comments Objective-C 3K SLoC // 0.0% comments GLSL 2.5K SLoC // 0.0% comments Rust 284 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

lib.rs:

See llama-cpp-2 for a documented and safe API.

Dependencies