#filtering #calculator #boilerplate #text #perplexity #abnormal

rustplexity

Simple bigram-based perplexity calculator, useful for filtering out boilerplate or other abnormal text

1 unstable release

0.1.0 Dec 30, 2023

#1208 in Text processing

MIT license

6KB
105 lines

rustplexity

based on this

Dependencies

~5–12MB
~124K SLoC