88 releases

new 0.1.103 May 2, 2025
0.1.102 Feb 25, 2025
0.1.91 Jan 30, 2025
0.1.85 Dec 5, 2024
0.1.45 Mar 27, 2024

#813 in Machine learning

Download history 408/week @ 2025-01-14 676/week @ 2025-01-21 715/week @ 2025-01-28 434/week @ 2025-02-04 793/week @ 2025-02-11 798/week @ 2025-02-18 749/week @ 2025-02-25 685/week @ 2025-03-04 2205/week @ 2025-03-11 1678/week @ 2025-03-18 1406/week @ 2025-03-25 1811/week @ 2025-04-01 1866/week @ 2025-04-08 1628/week @ 2025-04-15 1853/week @ 2025-04-22 1690/week @ 2025-04-29

7,307 downloads per month
Used in 9 crates (via llama-cpp-2)

MIT/Apache

6.5MB
129K SLoC

C++ 73K SLoC // 0.1% comments C 23K SLoC // 0.0% comments CUDA 10K SLoC // 0.0% comments GLSL 8K SLoC // 0.0% comments Metal Shading Language 5.5K SLoC // 0.0% comments Objective-C 5K SLoC // 0.0% comments Python 4.5K SLoC // 0.1% comments Rust 410 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

Dependencies