8 releases

0.1.8 Jun 1, 2020
0.1.7 May 15, 2019
0.1.6 Apr 20, 2019
0.1.5 Mar 9, 2019
0.1.3 Jan 25, 2019

#624 in Parser implementations

Download history 5/week @ 2022-03-06 36/week @ 2022-03-13 31/week @ 2022-03-20 1/week @ 2022-03-27 4/week @ 2022-04-03 1/week @ 2022-04-10 21/week @ 2022-04-24 40/week @ 2022-05-01 33/week @ 2022-05-08 139/week @ 2022-05-15 34/week @ 2022-05-22 61/week @ 2022-05-29 42/week @ 2022-06-05 3/week @ 2022-06-19

114 downloads per month

MIT license

79KB
2K SLoC

Javascript Lexer

Build Status Documentation Creates License

Javscript lexer implements high performance lexer of javscript as defined by ECMAScript 9

Output of the lexer together with description can be found in docs

Installation

add to cargo.toml

[dependencies]
javascript_lexer = "0.1"

Example

Lexer is invoked by running

extern crate javascript_lexer;

use javascript_lexer::Lexer;

fn main() {
    Lexer::parse_tokens("javascript");
}

lib.rs:

Lexer module consumes text input and produces linear stream of tokens.

Tokens are defined in token

Dependencies

~2.5MB
~54K SLoC