Lib.rs

Cargo Features

milli-core has no features set by default.

[dependencies]
milli-core = { version = "1.15.1", features = ["all-tokenizations", "lmdb-posix-sem", "chinese", "chinese-pinyin", "hebrew", "japanese", "japanese-transliteration", "korean", "thai", "greek", "khmer", "vietnamese", "german", "swedish-recomposition", "turkish", "cuda"] }

all-tokenizations

Enables charabia

Affects tests::language…

lmdb-posix-sem

Use POSIX semaphores instead of SysV semaphores in LMDB For more information on this feature, see heed's Cargo.toml

Enables posix-sem of heed

chinese chinese-pinyin?

allow chinese specialized tokenization

Enables chinese of charabia

chinese-pinyin = chinese

Enables chinese-normalization-pinyin of charabia

hebrew

allow hebrew specialized tokenization

Enables hebrew of charabia

japanese

allow japanese specialized tokenization

Enables japanese of charabia

japanese-transliteration

Enables japanese-transliteration of charabia

korean

allow korean specialized tokenization

Enables korean of charabia

thai

allow thai specialized tokenization

Enables thai of charabia

greek

allow greek specialized tokenization

Enables greek of charabia

khmer

allow khmer specialized tokenization

Enables khmer of charabia

vietnamese

allow vietnamese specialized tokenization

Enables vietnamese of charabia

german

allow german specialized tokenization

Enables german-segmentation of charabia

swedish-recomposition

force swedish character recomposition

Enables swedish-recomposition of charabia

turkish

allow turkish specialized tokenization

Enables turkish of charabia

cuda

allow CUDA support, see https://github.com/meilisearch/meilisearch/issues/4306

Enables cuda of candle-core ^0.8.2