Lib.rs

Cargo Features

gtars-tokenizers has no features set by default.

[dependencies]
gtars-tokenizers = { version = "0.5.2", features = ["huggingface"] }

huggingface

Enables hf-hub

gtars-tokenizers has 1 feature without comment.