#chinese #dictionary #builder #morphological #cc-cedict #tokenize

lindera-cc-cedict-builder

A Chinese morphological dictionary builder for CC-CEDICT

39 releases (21 breaking)

0.32.2 Jun 29, 2024
0.30.0 Apr 13, 2024
0.29.0 Mar 18, 2024
0.27.2 Dec 30, 2023
0.12.2 Mar 23, 2022

#1710 in Text processing

Download history 5073/week @ 2024-04-05 5406/week @ 2024-04-12 4557/week @ 2024-04-19 4799/week @ 2024-04-26 5130/week @ 2024-05-03 4877/week @ 2024-05-10 5555/week @ 2024-05-17 4914/week @ 2024-05-24 4504/week @ 2024-05-31 4897/week @ 2024-06-07 4268/week @ 2024-06-14 4668/week @ 2024-06-21 4612/week @ 2024-06-28 3060/week @ 2024-07-05 2964/week @ 2024-07-12 2464/week @ 2024-07-19

13,806 downloads per month
Used in 24 crates (4 directly)

MIT license

82KB
2K SLoC

Lindera CC-CEDICT Builder

License: MIT Join the chat at https://gitter.im/lindera-morphology/lindera Crates.io

CC-CEDICT dictionary builder for Lindera.

Dictionary format

Refer to the manual for details on the unidic-mecab dictionary format and part-of-speech tags.

Index Name (Chinese) Name (English) Notes
0 表面形式 Surface
1 左语境ID Left context ID
2 右语境ID Right context ID
3 成本 Cost
4 词类 Major POS classification
5 词类1 Middle POS classification
6 词类2 Small POS classification
7 词类3 Fine POS classification
8 併音 pinyin
9 繁体字 traditional
10 簡体字 simplified
11 定义 definition

User dictionary format (CSV)

Simple version

Index Name (Japanese) Name (English) Notes
0 表面形式 Surface
1 词类 Major POS classification
2 併音 pinyin

Detailed version

Index Name (Japanese) Name (English) Notes
0 表面形式 Surface
1 左语境ID Left context ID
2 右语境ID Right context ID
3 成本 Cost
4 词类 POS
5 词类1 POS subcategory 1
6 词类2 POS subcategory 2
7 词类3 POS subcategory 3
8 併音 pinyin
9 繁体字 traditional
10 簡体字 simplified
11 定义 definition
12 - - After 12, it can be freely expanded.

How to use CC-CEDICT dictionary

For more details about lindera command, please refer to the following URL:

API reference

The API reference is available. Please see following URL:

Dependencies

~9.5MB
~214K SLoC