Cargo Features

lindera-tokenizer has no features set by default.

[dependencies]
lindera-tokenizer = { version = "0.30.0", features = ["ipadic", "ipadic-neologd", "unidic", "ko-dic", "cc-cedict", "compress"] }
default

No directories included

ipadic

Include IPADIC dictionary (Japanese)

Enables ipadic of lindera-dictionary

ipadic-neologd

Include IPADIC NEologd dictionary (Japanese)

Enables ipadic-neologd of lindera-dictionary

unidic

Include UniDic dictionary (Japanese)

Enables unidic of lindera-dictionary

ko-dic

Include ko-dic dictionary (Korean)

Enables ko-dic of lindera-dictionary

cc-cedict

Include CC-CEDICT dictionary (Chinese)

Enables cc-cedict of lindera-dictionary

compress

Compress dictionaries

Enables compress of lindera-dictionary