rust_tokenizers is used at run time in 23 crates (of which 8 optionally). It is a direct run-time dependency in 9 crates. It's used only as a dev dependency in 1 crate.

Number of dependers rust_tokenizers version Downloads/month
15 8.1.1 2.8K
6 7.0.2 1.3K
1 5.0.1 7
2 3.1.6 290
Depender (with downloads and own rev deps) rust_tokenizers version
22K 15 text-splitter optional ^8
2.3K 16 rust-bert ^8.1.1
170 stablediffusion-wgpu ^8.1.0
rust_hero ~7.0.1
sbert ^7.0
automated ^8.1.0
250 1 llm-llama optional ^3.1.2
200 semchunk-rs optional ^8.1.1
2 divvunspell optional ^7
2 luminal dev ^8.1.0