Cargo Features
bpe-tokenizer has no features set by default.
[dependencies]
bpe-tokenizer = { version = "0.1.4", features = ["default-small", "default-medium", "default-large"] }- default-small = bincode, lz4_flex, serde
- default-medium = bincode, lz4_flex, serde
- default-large = bincode, lz4_flex, serde
Features from optional dependencies
In crates that don't use the dep: syntax, optional dependencies automatically become Cargo features. These features may have been created by mistake, and this functionality may be removed in the future.
- bincode default-large? default-medium? default-small?
-
Enables bincode
optional, only needed when defaul-{small,medium,large} are enabled
- lz4_flex default-large? default-medium? default-small?
- serde default-large? default-medium? default-small?