Lib.rs

Cargo Features

[dependencies]
tokenizer-lib = { version = "1.5.1", default-features = false, features = ["generator", "sized-tokens"] }

default = buffered, generator, parallel

These default features are set whenever tokenizer-lib is added without default-features = false somewhere in the dependency tree.

parallel buffered generator default

sized-tokens = source-map

Includes some features for tokens with a width

Affects tokenizer-lib::sized_tokens…

Features from optional dependencies

In crates that don't use the dep: syntax, optional dependencies automatically become Cargo features. These features may have been created by mistake, and this functionality may be removed in the future.

source-map sized-tokens?