Lib.rs

›
#tokenizer #hugging-face #structured #outputs #toktrie #llguidance

toktrie_hf_tokenizers

Owned by Michał Moskal.

15 releases

new 0.7.0 Mar 7, 2025
0.6.31 Mar 5, 2025
0.6.30 Feb 28, 2025

#4 in #outputs

Download history 339/week @ 2025-02-02 390/week @ 2025-02-09 315/week @ 2025-02-16 2379/week @ 2025-02-23 2678/week @ 2025-03-02

5,865 downloads per month

MIT license

83KB
2K SLoC

HuggingFace tokenizers library support for toktrie and llguidance

Dependencies

~14–27MB
~391K SLoC