Lib.rs

› Text processing | Visualization | Command line utilities
#text #nlp #analysis #numbers #key #metrics #words

bin+lib textalyzer

Analyze key metrics like number of words, readability, and complexity of any kind of text

by Adrian Sieber

2 releases

Uses old Rust 2015

0.2.1 Feb 18, 2019
0.2.0 Feb 18, 2019

#1297 in Text processing

AGPL-3.0-or-later

355KB
142 lines

Textalyzer

Analyze key metrics like number of words, readability, complexity, etc. of any kind of text.

Screenshot

Usage

textalyzer histogram <filepath>

Rewrite in Rust

This CLI tool was originally written in JavaScript and was later rewritten in Rust to improve the performance.

Before:

hyperfine --warmup 3 'time ./cli/index.js examples/1984.txt'
Benchmark #1: time ./cli/index.js examples/1984.txt
  Time (mean ± σ):     390.3 ms ±  15.6 ms    [User: 402.6 ms, System: 63.5 ms]
  Range (min … max):   366.7 ms … 425.7 ms

After:

hyperfine --warmup 3 'textalyzer histogram examples/1984.txt'
Benchmark #1: textalyzer histogram examples/1984.txt
  Time (mean ± σ):      40.4 ms ±   2.5 ms    [User: 36.0 ms, System: 2.7 ms]
  Range (min … max):    36.9 ms …  48.7 ms

Pretty impressive 10x performance improvement! 😁

  • wf - Command line utility for counting word frequency

Dependencies