Cargo Features
semchunk-rs has no features set by default.
[dependencies]
semchunk-rs = { version = "0.1.1", features = ["tiktoken-rs", "rust-bert", "rust_tokenizers"] }- tiktoken-rs
-
Enables tiktoken-rs
- rust-bert
-
Enables rust-bert
- rust_tokenizers
-
Enables rust_tokenizers
semchunk-rs has 3 features without comments.