Lib.rs

ethan-rs-wc (erwc)

ethan-rs-ws(erwc) is word, line, character, and byte count. Like wc command but not just wc command, more accurate and faster. Text can also be read from standard input for statistics.

中文

Getting Started

Manual Build

Requirements

• git
  • You'll know you did it right if you can run git --version and see a response like git version x.x.x
• rust
  • Install Rust according to the official documentation, when you open the shell and run rustc --version and see a response like rustc x.y.z (abcabcabc yyyy-mm-dd). And on the shell you run cargo --version and see a response like cargo x.y.z (abcabc yyyy-mm-dd). This means you successfully installed the Rust compilation environment.

$ git clone https://github.com/ethancws/ethan-rs-wc.git
$ cd ethan-rs-wc
$ cargo build --release

The path of command is target/release/erwc, you could copy/move it to other place or just cargo run --release -- <args>.

When you run the binary command file erwc directly, you can specify the relative path or absolute path of erwc, and then add the corresponding parameters. Or configure PATH for erwc.

Release

You could download the binary published in Release.

How to use

$ erwc tests/data/test.txt

You'll see like 9 5 38 42 tests/data/test.txt. In order, they are number of words, lines, characters, bytes and file path.

$ erwc -l tests/data/test.txt

You'll see like 5 tests/data/test.txt. The are number of lines and file path. This is the same as running the erwc --lines tests/data/test.txt command.

$ erwc -lwcbL tests/data/test.txt

You'll see like 9 5 38 42 tests/data/test.txt 30@5. In order, they are number of words, lines, characters, bytes and file path, the number of bytes with the most bytes, followed by the @ sign, then the line number with the most bytes.

You can run erwc -h or erwc --help get more information.

Quick examples comparison

These examples compare statistics for a given file, which varies in size from the smallest files to dozens of bytes to the largest 1.2G bytes. And statistics on multiple files at the same time. Timings were collected on a system with Intel(R) Core(TM) i7-8559U CPU @ 2.70GHz 4 core 16G.

In order to make the benchmark test as accurate and complete as possible, in addition to comparing the erwc command and the wc command, other commands are used to count the number of file lines and bytes, and compare the data statistics capabilities of the erwc and wc commands from the side.

In order to construct a large file of 1G bytes I used two commands to create tests/data/splitfile.txt and tests/data/largefile.txt file.

$ echo `base64 -i /dev/urandom | head -c 1000000000`｜ fold -w $((RANDOM % 50 + 50))  > tests/data/splitfile.txt

$ awk '{
  output = "";
  while (length($0) > 0) {
    len = int(rand() * 7) + 1;
    part = substr($0, 1, len);
    output = output (output ? " " : "") part;
    $0 = substr($0, len + 1);
  }
  print output;
}' tests/data/splitfile.txt > tests/data/largefile.txt

Single file statistics

Multi-file statistics

Count file lines

largefile.txt

splitfile.txt

sherlock.txt

test.txt

Statistics of the total number of bytes in the file

largefile.txt

splitfile.txt

sherlock.txt

test.txt

Running tests

$ cargo test

Thank You!

If you appreciated this, feel free to follow me or donate!

Solana Address: 3gArMnKUHkZ1eEry4dD8zdMpJH385HKrUdnG9ig6S5Zy

Resources

• Rust
• Crate