Lib.rs

›
#llama #cpp-bindings #low-level #cuda #api

sys babichjacob-llama-cpp-sys-2

Low Level Bindings to llama.cpp

Owned by babichjacob.

3 releases

0.1.82 Oct 8, 2024
0.1.81 Oct 8, 2024
0.1.80 Oct 8, 2024

#17 in #cpp-bindings

Download history 395/week @ 2024-10-07 38/week @ 2024-10-14 27/week @ 2024-11-04

83 downloads per month

MIT/Apache

5MB
105K SLoC

C++ 49K SLoC // 0.1% comments C 34K SLoC // 0.1% comments CUDA 7.5K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments Python 3K SLoC // 0.1% comments Objective-C 3K SLoC // 0.0% comments GLSL 2.5K SLoC // 0.0% comments Rust 283 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

lib.rs:

See llama-cpp-2 for a documented and safe API.

Dependencies