rust_tokenizers is used at run time in 22 crates (of which 7 optionally). It is a direct run-time dependency in 9 crates. It's used only as a dev dependency in 1 crate.

Number of dependers rust_tokenizers version Downloads/month
16 8.1.1 2.8K
5 7.0.2 1.3K
1 5.0.1 0
1 3.1.6 200
Depender (with downloads and own rev deps) rust_tokenizers version
16K 14 text-splitter optional ^8
1.8K 16 rust-bert ^8.1.1
sbert ^7.0
stablediffusion-wgpu ^8.1.0
automated ^8.1.0
rust_hero ~7.0.1
170 llm-llama optional ^3.1.2
semchunk-rs optional ^8.1.1
2 divvunspell optional ^7
2 luminal dev ^8.1.0