Lib.rs

› Science › Machine learning › syntaxdot
#tokenizers #subword #lemmatization #syntax #bert #sequence #labeling

syntaxdot-tokenizers

by Daniël de Kok

8 releases

0.5.0 Apr 24, 2023
0.5.0-beta.2 Nov 26, 2022
0.5.0-beta.1 Aug 5, 2022
0.5.0-beta.0 Jul 19, 2022
0.2.0 Nov 19, 2020

#806 in Machine learning


Used in 2 crates

MIT/Apache

17KB
337 lines

Subword tokenizers

Dependencies

~9MB
~129K SLoC