#tokenizers #containing #rule-based

paltoquet

A library of rule-based general-purpose tokenizers

22 releases (10 breaking)

0.11.0 Nov 18, 2024
0.10.0 Sep 26, 2024
0.4.0 Jul 30, 2024

#499 in Text processing

Download history 34/week @ 2024-09-11 342/week @ 2024-09-18 243/week @ 2024-09-25 45/week @ 2024-10-02 20/week @ 2024-10-09 18/week @ 2024-10-16 16/week @ 2024-10-23 16/week @ 2024-10-30 12/week @ 2024-11-06 274/week @ 2024-11-13 72/week @ 2024-11-20 30/week @ 2024-11-27 35/week @ 2024-12-04 61/week @ 2024-12-11 6/week @ 2024-12-18

107 downloads per month
Used in xan

MIT license

94KB
3K SLoC

Paltoquet

WIP...

Dependencies

~6MB
~143K SLoC