8 releases

0.5.0 Apr 24, 2023
0.5.0-beta.2 Nov 26, 2022
0.5.0-beta.1 Aug 5, 2022
0.5.0-beta.0 Jul 19, 2022
0.2.0 Nov 19, 2020

#944 in Machine learning

Download history 1/week @ 2024-11-29 12/week @ 2024-12-06 1/week @ 2024-12-13

60 downloads per month
Used in 2 crates

MIT/Apache

17KB
337 lines


Subword tokenizers

Dependencies

~9.5MB
~131K SLoC