Lib.rs

› Rendering › Graphics APIs
#llama #cpp-bindings #cuda #llama-cpp #api #sampler #low

sys llama-cpp-sys-4

Low Level Bindings to llama.cpp

Owned by Eugene Hauptmann.

12 releases

0.1.94 Feb 11, 2025
0.1.93 Feb 2, 2025
0.1.92 Jan 21, 2025
0.1.90 Dec 30, 2024
0.1.83 Oct 27, 2024

#513 in Graphics APIs

Download history 7/week @ 2024-11-14 243/week @ 2024-11-21 31/week @ 2024-11-28 124/week @ 2024-12-05 32/week @ 2024-12-12 157/week @ 2024-12-19 144/week @ 2024-12-26 53/week @ 2025-01-02 163/week @ 2025-01-09 112/week @ 2025-01-16 10/week @ 2025-01-23 128/week @ 2025-01-30 95/week @ 2025-02-06 74/week @ 2025-02-13 2/week @ 2025-02-20 6/week @ 2025-02-27

181 downloads per month
Used in llama-cpp-4

MIT/Apache

7MB
134K SLoC

C++ 81K SLoC // 0.1% comments C 30K SLoC // 0.1% comments CUDA 9K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments Objective-C 4K SLoC // 0.0% comments Python 4K SLoC // 0.1% comments Rust 501 SLoC // 0.3% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support, including new Sampler API from llama-cpp.

See llama-cpp-4 for a safe API.

OpenMPI support

brew install open-mpi
cargo build -F mpi

lib.rs:

See llama-cpp-4 for a documented and safe API.

Dependencies