20 releases
Uses new Rust 2024
| new 0.6.5 | May 19, 2025 |
|---|---|
| 0.6.3 | Apr 17, 2025 |
| 0.5.11 | Mar 27, 2025 |
| 0.5.10 | Nov 22, 2024 |
| 0.4.1 | Dec 20, 2023 |
#835 in Text processing
263 downloads per month
500KB
11K
SLoC
Custom text tokenizer
Dependencies
~1MB
~18K SLoC