Lib.rs

› Science › Machine learning
#cpp-bindings #low-level #llama #cuda #api

sys llama-cpp-sys-2

Low Level Bindings to llama.cpp

by MarcusDunn, Sepehr and 36 contributors

87 releases

0.1.102 Feb 25, 2025
0.1.91 Jan 30, 2025
0.1.85 Dec 5, 2024
0.1.84 Nov 27, 2024
0.1.45 Mar 27, 2024

#880 in Machine learning

Download history 477/week @ 2024-11-27 1224/week @ 2024-12-04 742/week @ 2024-12-11 237/week @ 2024-12-18 187/week @ 2024-12-25 536/week @ 2025-01-01 268/week @ 2025-01-08 456/week @ 2025-01-15 666/week @ 2025-01-22 738/week @ 2025-01-29 437/week @ 2025-02-05 802/week @ 2025-02-12 913/week @ 2025-02-19 677/week @ 2025-02-26 762/week @ 2025-03-05 2000/week @ 2025-03-12

4,463 downloads per month
Used in 6 crates (via llama-cpp-2)

MIT/Apache

6MB
118K SLoC

C++ 59K SLoC // 0.1% comments C 30K SLoC // 0.1% comments CUDA 9K SLoC // 0.0% comments GLSL 5.5K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments Objective-C 4K SLoC // 0.0% comments Python 4K SLoC // 0.1% comments Rust 409 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

lib.rs:

See llama-cpp-2 for a documented and safe API.

Dependencies