#reader #char #unicode

char_reader

Safely read wild streams as chars or lines

2 releases

0.1.1 Nov 2, 2021
0.1.0 Nov 4, 2020

#1292 in Text processing

Download history 314/week @ 2023-11-19 260/week @ 2023-11-26 283/week @ 2023-12-03 235/week @ 2023-12-10 352/week @ 2023-12-17 301/week @ 2023-12-24 352/week @ 2023-12-31 218/week @ 2024-01-07 203/week @ 2024-01-14 135/week @ 2024-01-21 253/week @ 2024-01-28 314/week @ 2024-02-04 221/week @ 2024-02-11 369/week @ 2024-02-18 401/week @ 2024-02-25 326/week @ 2024-03-03

1,358 downloads per month
Used in 3 crates

MIT license

15KB
209 lines

MIT Latest Version docs Chat on Miaou

BufRead's read_line may be a problem when you need performance and safety on unvetted streams:

You may wait forever or get an out of memory panic if there's no newline in the stream. And even if there's one, it may be way past what you need: you'll have to keep everything in memory just to get to the start of the following line.

CharReader is a buffered reader fixing those problems.

  • you can read lines without choking on an infinite stream without newlines
  • you can read lines and not store more than necessary if you just want the beginning
  • there's a next_char function to read only one char

It's suitable when you'd like to read UTF8 lines and aren't sure the data are kind enough.

When reading a line, you pass two parameters:

  • the max number of chars you want to get (rest of line will be dropped)
  • the max number of chars before giving out with an error (thus protecting against infinite streams)

All errors are io::Error:

  • UTF8 errors are of kind InvalidData
  • Lines exceeding your threshold are of kind Other

Alternative: If you know in advance how many lines you'd need and you always want whole lines, the standard take method of BufReader protects you against memory overflows.

No runtime deps