Lib.rs

› Users #tokenizer #text

n1t0

Anthony MOI

Joined crates-io 3 years ago. Joined GitHub 11 years ago.

Member of GitHub orgs

totemstech, huggingface

Collaborated with

Anthony MOI created 1 crate

unicode-normalization-alignments

36K Founded in Dec 2019. Last updated 3 years ago.

Co-owns 1 crate

tokenizers

11K Member since Dec 2019 (3 years)