#tokenizers #rule-based #containing

paltoquet

A library of rule-based general-purpose tokenizers

22 releases (10 breaking)

0.11.0 Nov 18, 2024
0.10.0 Sep 26, 2024
0.4.0 Jul 30, 2024

#508 in Text processing

Download history 17/week @ 2024-10-21 9/week @ 2024-10-28 24/week @ 2024-11-04 138/week @ 2024-11-11 199/week @ 2024-11-18 30/week @ 2024-11-25 27/week @ 2024-12-02 71/week @ 2024-12-09 13/week @ 2024-12-16 14/week @ 2025-01-06 23/week @ 2025-01-13 64/week @ 2025-01-20 42/week @ 2025-01-27 20/week @ 2025-02-03

152 downloads per month
Used in xan

MIT license

94KB
3K SLoC

Paltoquet

WIP...

Dependencies

~6MB
~142K SLoC