Lib.rs

›
#tokenizer #hugging-face #structured #outputs #toktrie #llguidance

toktrie_hf_tokenizers

Owned by Michał Moskal.

7 releases

new 0.6.24 Feb 11, 2025
0.6.23 Feb 10, 2025

#6 in #outputs

Download history 535/week @ 2025-02-03

535 downloads per month

MIT license

80KB
2K SLoC

HuggingFace tokenizers library support for toktrie and llguidance

Dependencies

~14–27MB
~389K SLoC