#tokenizers #containing #rule-based

paltoquet

A library of rule-based general-purpose tokenizers

16 releases (6 breaking)

0.7.0 Aug 23, 2024
0.6.1 Aug 2, 2024
0.5.1 Aug 1, 2024
0.4.0 Jul 30, 2024
0.1.1 Jul 26, 2024

#471 in Text processing

Download history 100/week @ 2024-07-20 974/week @ 2024-07-27 81/week @ 2024-08-03 14/week @ 2024-08-10 102/week @ 2024-08-17 51/week @ 2024-08-24 21/week @ 2024-08-31 31/week @ 2024-09-07

208 downloads per month
Used in xan

MIT license

69KB
2K SLoC

Paltoquet

WIP...

Dependencies

~6MB
~141K SLoC