26 releases (8 breaking)

0.13.0 Nov 15, 2023
0.12.3 Jun 27, 2023
0.12.0 May 31, 2023

#913 in Science

Download history 21/week @ 2023-11-06 47/week @ 2023-11-13 77/week @ 2023-11-20 121/week @ 2023-11-27 65/week @ 2023-12-04 42/week @ 2023-12-11 33/week @ 2023-12-18 70/week @ 2023-12-25 10/week @ 2024-01-01 17/week @ 2024-01-08 20/week @ 2024-01-15 12/week @ 2024-01-22 61/week @ 2024-01-29 40/week @ 2024-02-05 116/week @ 2024-02-12 650/week @ 2024-02-19

867 downloads per month
Used in llm-chain-llama

MIT license

1MB
22K SLoC

C 10K SLoC // 0.1% comments C++ 5K SLoC // 0.1% comments Rust 4.5K SLoC // 0.0% comments Python 1K SLoC // 0.1% comments CUDA 545 SLoC // 0.0% comments Shell 178 SLoC // 0.2% comments Zig 50 SLoC Batch 48 SLoC Swift 20 SLoC

llama-sys

llama-sys is a set of bindgen generated wrappers for llama.cpp. This crate provides a low-level interface to llama.cpp, allowing you to use it in your Rust projects. To use llama-sys, simply add the following to your Cargo.toml file:

[dependencies]
llama-sys = "0.1.0"
use llama_sys::\*;

Note that llama-sys provides a lower-level interface than llm-chain-llama, and may be more difficult to use. However, if you need fine-grained control over llama.cpp, llama-sys is the way to go.

No runtime deps