Lib.rs

› Rendering › Graphics APIs
#llama #cpp-bindings #cuda #low-level #api

sys babichjacob-llama-cpp-sys-2

Low Level Bindings to llama.cpp

Owned by babichjacob.

4 releases

0.1.85 Dec 5, 2024
0.1.82 Oct 8, 2024
0.1.81 Oct 8, 2024
0.1.80 Oct 8, 2024

#549 in Graphics APIs

Download history 395/week @ 2024-10-07 38/week @ 2024-10-14 27/week @ 2024-11-04 152/week @ 2024-12-02 133/week @ 2024-12-09

285 downloads per month
Used in babichjacob-llama-cpp-2

MIT/Apache

5.5MB
107K SLoC

C++ 50K SLoC // 0.1% comments C 34K SLoC // 0.1% comments CUDA 8K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments Objective-C 4K SLoC // 0.0% comments Python 3.5K SLoC // 0.1% comments GLSL 3K SLoC // 0.0% comments Rust 284 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

lib.rs:

See llama-cpp-2 for a documented and safe API.

Dependencies