#ggml #gguf #llama-cpp

ggml-quants

GGml defined quantized data types and their quant/dequant algorithm

1 unstable release

0.0.0 Nov 25, 2024

#6 in #llama-cpp

Download history 88/week @ 2024-11-19 81/week @ 2024-11-26 21/week @ 2024-12-03 18/week @ 2024-12-10 14/week @ 2024-12-17 31/week @ 2024-12-24 6/week @ 2025-01-07 11/week @ 2025-01-14 5/week @ 2025-01-21 4/week @ 2025-01-28 36/week @ 2025-02-04 23/week @ 2025-02-11

69 downloads per month
Used in 2 crates (via ggus)

MIT license

32KB
1K SLoC

ggml-quants

CI Latest version Documentation license

ggml-quants is a Rust library that implements the quantized data types defined by ggml and their corresponding quantization and dequantization algorithms.

Dependencies

~1.5MB
~31K SLoC