Lib.rs

Cargo Features

[dependencies]
minbpe = { version = "0.1.0", default-features = false, features = ["basic", "regex", "gpt4", "tiktoken_tests"] }

default = basic, regex

These default features are set whenever minbpe is added without default-features = false somewhere in the dependency tree.

basic default

Affects minbpe::basic…

regex default gpt4?

Affects minbpe::regex…

gpt4 tiktoken_tests? = regex

Affects minbpe::gpt4…

tiktoken_tests = gpt4, tiktoken-rs

Features from optional dependencies

In crates that don't use the dep: syntax, optional dependencies automatically become Cargo features. These features may have been created by mistake, and this functionality may be removed in the future.

tiktoken-rs tiktoken_tests?

Enables tiktoken-rs ^0.5.8