4 releases
0.1.3 | Mar 3, 2024 |
---|---|
0.1.2 | Mar 3, 2024 |
0.1.1 | Mar 3, 2024 |
0.1.0 | Mar 3, 2024 |
#1960 in Command line utilities
97 downloads per month
140KB
154 lines
RRRS: Rust(ic) Rapid Random Sampler
Welcome to RRRS, a rapid, hyper-optimized CSV random sampling tool designed with performance and efficiency at its core. Crafted meticulously in Rust, RRRS offers an unparalleled solution for extracting random data samples from CSV files swiftly and effortlessly.
๐คจ Why RRRS
Born out of a frustrating, repetitive process of sampling from unwieldy or enormous CSV files during my time at Washington University in St. Louis, RRRS (Rust(ic) Rapid Random Sampler) represents more than just a tool; it's a perhaps slightly redundant, but fun mission to over-optimize and speed up the all-too-familiar frustration of data sampling. As a student navigating the complex waters of data-heavy courses, I found myself constantly bogged down by the inefficiency of existing methods of importing massive datasets into spreadsheet software, waiting for them to load, and then struggling with plugins or scripting to extract the samples I needed. It was clear: there had to be a better way. So, instead of doing my homework, I work on this:
Enter RRRS. Developed with the speed and efficiency of Rust, RRRS is my answer to those frustrating hours. It's designed to make random sampling from large CSV files not just faster, but a seamless part of your workflow. This tool is for anyone who's ever felt this nuisance, turning what was once a bottleneck into a smooth, efficient process. With RRRS, I'm excited to share a solution that helped me and is now here to support data enthusiasts and professionals alike in their analytical endeavors.
๐ Features
- Rapid Random Sampling: Quickly extract random samples from large CSV files.
- Hyper-Optimized Performance: Leveraging Rust's powerful system-level capabilities for maximum speed.
- User-Friendly: Simple command-line interface to easily specify input and output.
- Flexibility: Customizable random sampling according to your data analysis needs.
- Cross-Platform Compatibility: Runs seamlessly on any platform supporting Rust.
๐ Usage
To get started with RRRS, follow these simple steps:
rrrs -i <input_file_path> -o <output_file_path>
Upon execution, RRRS will prompt you to enter the desired number of rows to be randomly sampled from your CSV file. The output will be a new CSV file with the original file title and a suffix indicating the number of sampled rows (e.g., slogan_data-100
). This file will be saved in the execution path or a specified output directory.
๐ Directory Structure
Understand the organization of RRRS with the following directory structure:
rrrs/
โโโ Cargo.toml # Project manifest
โโโ src/ # Source files
โ โโโ main.rs # Entry point
โ โโโ library.rs # Library code
โ โโโ args.rs # Argument parsing
โ โโโ library/ # Library code
โ โโโ sampler_ops/ # Sampling operations
โ โ โโโ sampler_ops.rs # Sampling logic
โ โโโ csv_ops/ # CSV operations
โ โโโ csv_loader.rs # CSV loading functionality
โ โโโ csv_writer.rs # CSV writing functionality
โโโ tests/ # Automated tests
โโโ args_tests.rs # Tests for argument parsing
โโโ csv_loader_tests.rs # Tests for CSV loading
โโโ sampler_tests.rs # Tests for sampling logic
โโโ csv_writer_tests.rs # Tests for CSV writing
๐ Getting Started
MacOS and Linux
To use RRRS, you need to have Rust installed on your machine. If you don't have Rust installed, install it using the following command: curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
. For more information, refer to the official Rust installation guide here.
Once Rust is installed, you can install RRRS using the following command: cargo install rrrs
.
Windows
Note: RRRS is not yet supported on Windows. However, you can still use it by installing the Windows Subsystem for Linux.
Building from Source
To build RRRS from source, you can clone the repository and build it using the following commands (Note that this is primarily for development purposes):
git clone git@github.com:ethan-wickstrom/rrrs.git
cd rrrs
cargo build --release
cp target/release/rrrs /usr/local/bin
๐ค Contributing
Contributions to RRRS are warmly welcomed. Feel free to open an issue or submit a pull request, whether it's bug reports, feature requests, or code contributions. Please refer to the contributing guidelines for more details.
๐ License
RRRS is open-sourced under the Apache-2.0 license. See the LICENSE file for more details.
Dependencies
~42โ73MB
~1.5M SLoC