unwalk

Simple program to walk directory recursively and find .gz files to perform un-gzip process, which might be useful when copying files over from S3 / HDFS with compression turned on.

This program may be possible to perform other modular actions in the future.

How to install

Use https://www.rustup.rs/ and get the commands cargo and rustc.

Run cargo install unwalk for the installation.

How to run

Assuming there are .gz files located within data/:

unwalk data/

The above command will walk all sub-directories recursively from data/, un-gzipping all found .gz files, but not deleting any of the original .gz files after successful un-gzipping.

To delete the files, add -d as such:

unwalk -d data/

For more information on the available CLI arguments, run:

unwalk -h

How to build

Run cargo build --all --release. This builds all the associated libraries and the executable. The executable will be built in target/release/unwalk.

lib.rs:

unwalk-base

Provide un-gzip implementation as the action on matching files.