1 unstable release
| 0.1.0 | Oct 27, 2024 |
|---|
#22 in #column
129 downloads per month
Used in 2 crates
(via toy-json-formatter)
11KB
291 lines
Generic Tokenizer
This crate provides a generic tokenizer that includes line and column numbers. This is useful for things like higher-level tokenizers, parsers, and language servers that need to track line and column numbers as they go.