#ggml #gguf #llama-cpp

ggml-quants

GGml defined quantized data types and their quant/dequant algorithm

1 unstable release

0.0.0 Nov 25, 2024

#6 in #gguf

Download history 141/week @ 2024-11-22 41/week @ 2024-11-29 21/week @ 2024-12-06 13/week @ 2024-12-13 16/week @ 2024-12-20 21/week @ 2024-12-27

79 downloads per month
Used in 2 crates (via ggus)

MIT license

32KB
1K SLoC

ggml-quants

CI Latest version Documentation license

ggml-quants is a Rust library that implements the quantized data types defined by ggml and their corresponding quantization and dequantization algorithms.

Dependencies

~1.5MB
~31K SLoC