Lib.rs

Cargo Features

[dependencies]
tokenizers-enfer = { version = "0.21.1", default-features = false, features = ["esaxx_fast", "progressbar", "http", "unstable_wasm", "onig"] }

default = esaxx_fast, http, onig, progressbar

These default features are set whenever tokenizers-enfer is added without default-features = false somewhere in the dependency tree.

esaxx_fast default

Enables cpp of esaxx-rs

progressbar default = indicatif

http default = hf-hub-enfer

unstable_wasm = fancy-regex

Enables js of getrandom

Features from optional dependencies

In crates that don't use the dep: syntax, optional dependencies automatically become Cargo features. These features may have been created by mistake, and this functionality may be removed in the future.

onig default

indicatif progressbar

hf-hub-enfer http

fancy-regex unstable_wasm?

Enables fancy-regex ^0.13