Lib.rs

Cargo Features

[dependencies]
tokenizer = { version = "0.1.2", default-features = false, features = ["single-thread", "multi-thread"] }

default = multi-thread

The multi-thread feature is set by default whenever tokenizer is added without default-features = false somewhere in the dependency tree.

single-thread

multi-thread default = rayon

Features from optional dependencies

In crates that don't use the dep: syntax, optional dependencies automatically become Cargo features. These features may have been created by mistake, and this functionality may be removed in the future.

rayon multi-thread