#morphological #ko-dic #dictionary #korean

lindera-ko-dic

A Japanese morphological dictionary for ko-dic

58 releases (31 breaking)

new 0.43.0 May 24, 2025
0.42.2 Apr 29, 2025
0.40.1 Mar 27, 2025
0.38.1 Nov 30, 2024
0.12.2 Mar 23, 2022

#2050 in Text processing

Download history 3310/week @ 2025-02-01 3391/week @ 2025-02-08 3726/week @ 2025-02-15 5541/week @ 2025-02-22 5393/week @ 2025-03-01 4604/week @ 2025-03-08 4382/week @ 2025-03-15 4643/week @ 2025-03-22 8147/week @ 2025-03-29 6409/week @ 2025-04-05 5807/week @ 2025-04-12 8276/week @ 2025-04-19 5916/week @ 2025-04-26 5575/week @ 2025-05-03 8104/week @ 2025-05-10 5014/week @ 2025-05-17

25,750 downloads per month
Used in 12 crates (via lindera)

MIT license

145KB
3K SLoC

Lindera ko-dic

License: MIT Crates.io

Dictionary version

This repository contains mecab-ko-dic.

Dictionary format

Information about the dictionary format and part-of-speech tags used by mecab-ko-dic id documented in this Google Spreadsheet, linked to from mecab-ko-dic's repository readme.

Note how ko-dic has one less feature column than NAIST JDIC, and has an altogether different set of information (e.g. doesn't provide the "original form" of the word).

The tags are a slight modification of those specified by 세종 (Sejong), whatever that is. The mappings from Sejong to mecab-ko-dic's tag names are given in tab 태그 v2.0 on the above-linked spreadsheet.

The dictionary format is specified fully (in Korean) in tab 사전 형식 v2.0 of the spreadsheet. Any blank values default to *.

Index Name (Korean) Name (English) Notes
0 표면 Surface
1 왼쪽 문맥 ID Left context ID
2 오른쪽 문맥 ID Right context ID
3 비용 Cost
4 품사 태그 part-of-speech tag See 태그 v2.0 tab on spreadsheet
5 의미 부류 meaning (too few examples for me to be sure)
6 종성 유무 presence or absence T for true; F for false; else *
7 읽기 reading usually matches surface, but may differ for foreign words e.g. Chinese character words
8 타입 type One of: Inflect (활용); Compound (복합명사); or Preanalysis (기분석)
9 첫번째 품사 first part-of-speech e.g. given a part-of-speech tag of "VV+EM+VX+EP", would return VV
10 마지막 품사 last part-of-speech e.g. given a part-of-speech tag of "VV+EM+VX+EP", would return EP
11 표현 expression 활용, 복합명사, 기분석이 어떻게 구성되는지 알려주는 필드 – Fields that tell how usage, compound nouns, and key analysis are organized

User dictionary format (CSV)

Simple version

Index Name (Japanese) Name (English) Notes
0 표면 Surface
1 품사 태그 part-of-speech tag See 태그 v2.0 tab on spreadsheet
2 읽기 reading usually matches surface, but may differ for foreign words e.g. Chinese character words

Detailed version

Index Name (Korean) Name (English) Notes
0 표면 Surface
1 왼쪽 문맥 ID Left context ID
2 오른쪽 문맥 ID Right context ID
3 비용 Cost
4 품사 태그 part-of-speech tag See 태그 v2.0 tab on spreadsheet
5 의미 부류 meaning (too few examples for me to be sure)
6 종성 유무 presence or absence T for true; F for false; else *
7 읽기 reading usually matches surface, but may differ for foreign words e.g. Chinese character words
8 타입 type One of: Inflect (활용); Compound (복합명사); or Preanalysis (기분석)
9 첫번째 품사 first part-of-speech e.g. given a part-of-speech tag of "VV+EM+VX+EP", would return VV
10 마지막 품사 last part-of-speech e.g. given a part-of-speech tag of "VV+EM+VX+EP", would return EP
11 표현 expression 활용, 복합명사, 기분석이 어떻게 구성되는지 알려주는 필드 – Fields that tell how usage, compound nouns, and key analysis are organized
12 - - After 12, it can be freely expanded.

API reference

The API reference is available. Please see following URL:

Dependencies

~11–22MB
~368K SLoC