Lib.rs

› Science › Machine learning
#cpp-bindings #low-level #llama #cuda #api

sys llama-cpp-sys-2

Low Level Bindings to llama.cpp

by MarcusDunn, Sepehr and 30 contributors

70 releases

0.1.85 Dec 5, 2024
0.1.84 Nov 27, 2024
0.1.83 Oct 29, 2024
0.1.64 Jul 26, 2024
0.1.45 Mar 27, 2024

#837 in Machine learning

Download history 195/week @ 2024-08-26 29/week @ 2024-09-02 20/week @ 2024-09-09 153/week @ 2024-09-16 197/week @ 2024-09-23 63/week @ 2024-09-30 517/week @ 2024-10-07 368/week @ 2024-10-14 125/week @ 2024-10-21 287/week @ 2024-10-28 257/week @ 2024-11-04 290/week @ 2024-11-11 535/week @ 2024-11-18 414/week @ 2024-11-25 907/week @ 2024-12-02 1344/week @ 2024-12-09

3,222 downloads per month
Used in 6 crates (via llama-cpp-2)

MIT/Apache

5MB
98K SLoC

C++ 50K SLoC // 0.1% comments C 34K SLoC // 0.1% comments CUDA 8K SLoC // 0.0% comments Python 3.5K SLoC // 0.1% comments GLSL 3K SLoC // 0.0% comments Rust 284 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

lib.rs:

See llama-cpp-2 for a documented and safe API.

Dependencies