Lib.rs

› Text processing
#japanese #morphological #analyzer #kytea

kytea-tokenizer

Wrapper of tokenization by KyTea

by Masato Nakata

25 releases (9 breaking)

new 0.10.0 May 28, 2023
0.8.2 Mar 23, 2023
0.5.2 Jul 18, 2022
0.3.0 Nov 26, 2021

#1197 in Text processing

Download history 24/week @ 2023-02-03 54/week @ 2023-02-10 120/week @ 2023-02-17 68/week @ 2023-02-24 17/week @ 2023-03-03 8/week @ 2023-03-10 36/week @ 2023-03-17 23/week @ 2023-03-24 52/week @ 2023-03-31 43/week @ 2023-04-07 38/week @ 2023-04-14 34/week @ 2023-04-21 6/week @ 2023-04-28 52/week @ 2023-05-05 2/week @ 2023-05-12 2/week @ 2023-05-19

65 downloads per month

MIT/Apache

42KB
1K SLoC

About

kytea-tokenizer is a wrapper of KyTea, the japanese morphological analyzer.

lib.rs:

kytea-tokenizer is a wrapper of KyTea, the japanese morphological analyzer.

Dependencies

~1–32MB
~527K SLoC