3 unstable releases
0.2.1 | Feb 28, 2024 |
---|---|
0.2.0 | Feb 18, 2024 |
0.1.0 | Dec 16, 2023 |
#676 in Machine learning
39 downloads per month
Used in 8 crates
(5 directly)
115KB
3K
SLoC
kalosm-sample
This is a sampling library for Kalosm.
It handles choosing a token from a probability distribution. Samplers can be used to constrain the generation of text for example you can use a sampler to prevent the model from generating the same word twice in a row. Or you could only allow the model to generate a list of single digit numbers.
Dependencies
~23MB
~466K SLoC