Lib.rs

› Science › Machine learning
#cpp-bindings #low-level #llama #cuda #api

sys llama-cpp-sys-2

Low Level Bindings to llama.cpp

by MarcusDunn, Sepehr and 32 contributors

73 releases

new 0.1.88 Jan 20, 2025
0.1.85 Dec 5, 2024
0.1.84 Nov 27, 2024
0.1.64 Jul 26, 2024
0.1.45 Mar 27, 2024

#765 in Machine learning

Download history 63/week @ 2024-09-30 517/week @ 2024-10-07 368/week @ 2024-10-14 125/week @ 2024-10-21 287/week @ 2024-10-28 257/week @ 2024-11-04 290/week @ 2024-11-11 535/week @ 2024-11-18 414/week @ 2024-11-25 907/week @ 2024-12-02 1100/week @ 2024-12-09 296/week @ 2024-12-16 206/week @ 2024-12-23 443/week @ 2024-12-30 302/week @ 2025-01-06 328/week @ 2025-01-13

1,324 downloads per month
Used in 6 crates (via llama-cpp-2)

MIT/Apache

5.5MB
106K SLoC

C++ 50K SLoC // 0.1% comments C 34K SLoC // 0.1% comments CUDA 8K SLoC // 0.0% comments Metal Shading Language 4.5K SLoC // 0.1% comments Objective-C 3.5K SLoC // 0.0% comments Python 3.5K SLoC // 0.1% comments GLSL 3K SLoC // 0.0% comments Rust 304 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

lib.rs:

See llama-cpp-2 for a documented and safe API.

Dependencies