5 releases
0.1.1 | May 8, 2023 |
---|---|
0.1.0-rc4 | May 8, 2023 |
0.1.0-rc3 | May 7, 2023 |
0.1.0-rc1 | May 4, 2023 |
#1015 in Machine learning
323 downloads per month
Used in 12 crates
(via llm-base)
3.5MB
26K
SLoC
ggml
is a semi-idiomatic wrapper for the ggml
C library.
It exposes a subset of operations (currently used to implement the llm library). Note that it does not expose a fully-idiomatic safe Rust interface; operations that could be potentially unsafe are marked as such.
ggml
operates on a computational graph; no values will be computed until Context::graph_compute is executed.
All [Tensor]s are nodes in this computational graph, and values cannot be retrieved until computation is completed.