#filtering #boilerplate #calculator #text #perplexity #abnormal

rustplexity

Simple bigram-based perplexity calculator, useful for filtering out boilerplate or other abnormal text

1 unstable release

0.1.0 Dec 30, 2023

#1077 in Text processing

Download history 11/week @ 2024-07-28 183/week @ 2024-08-18 167/week @ 2024-08-25 220/week @ 2024-09-01 224/week @ 2024-09-08 104/week @ 2024-09-15

747 downloads per month

MIT license

6KB
105 lines

rustplexity

based on this

Dependencies

~5–12MB
~122K SLoC