Lib.rs

› Science › Machine learning
#cpp-bindings #low-level #llama #cuda #api

sys llama-cpp-sys-2

Low Level Bindings to llama.cpp

by MarcusDunn, Sepehr and 28 contributors

68 releases

0.1.83 Oct 29, 2024
0.1.69 Aug 30, 2024
0.1.64 Jul 26, 2024
0.1.45 Mar 27, 2024

#872 in Machine learning

Download history 123/week @ 2024-07-21 84/week @ 2024-07-28 117/week @ 2024-08-04 185/week @ 2024-08-11 362/week @ 2024-08-18 197/week @ 2024-08-25 48/week @ 2024-09-01 20/week @ 2024-09-08 150/week @ 2024-09-15 196/week @ 2024-09-22 51/week @ 2024-09-29 519/week @ 2024-10-06 360/week @ 2024-10-13 134/week @ 2024-10-20 276/week @ 2024-10-27 277/week @ 2024-11-03

1,089 downloads per month
Used in 6 crates (via llama-cpp-2)

MIT/Apache

5MB
105K SLoC

C++ 49K SLoC // 0.1% comments C 34K SLoC // 0.1% comments CUDA 7.5K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments Python 3K SLoC // 0.1% comments Objective-C 3K SLoC // 0.0% comments GLSL 2.5K SLoC // 0.0% comments Rust 284 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

lib.rs:

See llama-cpp-2 for a documented and safe API.

Dependencies