#tokenizers #containing #rule-based

paltoquet

A library of rule-based general-purpose tokenizers

20 releases (9 breaking)

0.10.0 Sep 26, 2024
0.8.1 Sep 19, 2024
0.4.0 Jul 30, 2024

#471 in Text processing

Download history 931/week @ 2024-07-26 222/week @ 2024-08-02 13/week @ 2024-08-09 11/week @ 2024-08-16 144/week @ 2024-08-23 10/week @ 2024-08-30 35/week @ 2024-09-06 156/week @ 2024-09-13 350/week @ 2024-09-20 107/week @ 2024-09-27

648 downloads per month
Used in xan

MIT license

92KB
2.5K SLoC

Paltoquet

WIP...

Dependencies

~6MB
~142K SLoC