Lib.rs

› Science › Machine learning
#cpp-bindings #low-level #llama #cuda #api

sys llama-cpp-sys-2

Low Level Bindings to llama.cpp

by MarcusDunn, Sepehr and 35 contributors

83 releases

new 0.1.98 Feb 21, 2025
0.1.91 Jan 30, 2025
0.1.85 Dec 5, 2024
0.1.84 Nov 27, 2024
0.1.45 Mar 27, 2024

#811 in Machine learning

Download history 305/week @ 2024-10-29 232/week @ 2024-11-05 515/week @ 2024-11-12 345/week @ 2024-11-19 419/week @ 2024-11-26 1008/week @ 2024-12-03 997/week @ 2024-12-10 265/week @ 2024-12-17 194/week @ 2024-12-24 491/week @ 2024-12-31 294/week @ 2025-01-07 408/week @ 2025-01-14 676/week @ 2025-01-21 715/week @ 2025-01-28 434/week @ 2025-02-04 723/week @ 2025-02-11

2,651 downloads per month
Used in 6 crates (via llama-cpp-2)

MIT/Apache

6MB
118K SLoC

C++ 59K SLoC // 0.1% comments C 30K SLoC // 0.1% comments CUDA 9K SLoC // 0.0% comments GLSL 5.5K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments Objective-C 4K SLoC // 0.0% comments Python 4K SLoC // 0.1% comments Rust 391 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

lib.rs:

See llama-cpp-2 for a documented and safe API.

Dependencies