fiux

The fastest multi-format file converter CLI tool.

• Supports NDJSON, JSON, CSV, PSV, TSV, TOML formats and more!

• Support for more formats will be added soon.

Features

• Convert between NDJSON, JSON, TOML, CSV, TSV, PSV and more!
• Validate files quickly with detailed logs for debugging
• The fastest thanks to being written in highly optimized Rust
• Highly memory efficient for low resource environments through streaming architecture and optimized allocations.
• Intuitive and easy to use out of the box, built in 100% pure Rust which makes it easy to install.

Installation

cargo install fiux

• And that's it! You've installed fiux!

Usage

# conversion
fiux convert <INPUT> -o <OUTPUT>

# validation
fiux validate <INPUT>

# options (flags)
fiux validate <INPUT> --log-file err.md
fiux convert <INPUT> --output <OUTPUT> -a

benchmarks

Benchmarks were done with a 100k line CSV converted to other formats for consistency across benchmarks

Example benchmark

• This is a sample of the command used to capture these benchmarks and its output:

$ hyperfine -w 5  "mlr --c2j cat test100k.csv > temp.json" "fiux convert test100k.csv -o temp.json"
Benchmark 1: mlr --c2j cat test100k.csv > temp.json
  Time (mean ± σ):     605.9 ms ±  38.0 ms    [User: 1223.0 ms, System: 271.8 ms]
  Range (min … max):   556.0 ms … 677.0 ms    50 runs

Benchmark 2: fiux convert test100k.csv -o temp.json
  Time (mean ± σ):     107.5 ms ±  12.5 ms    [User: 95.1 ms, System: 17.2 ms]
  Range (min … max):    83.2 ms … 123.9 ms    50 runs

Summary
  fiux convert test100k.csv -o temp.json ran
    5.24 ± 1.07 times faster than mlr --c2j cat test100k.csv > temp.json

Results

As you can see from these benchmarks, fiux is much faster than most industry-standard file conversion tools, fiux scales even better on better / server hardware! (using SSH)

Note: TOML conversions are generally slower than other formats since TOML is very limited when it comes to streaming and parsing is slower as it is more complicated than other formats.

Notes

• fiux is licensed under the MIT license.
• For specifics about contributing to fiux, see CONTRIBUTING.md.
• For changes, see CHANGELOG.md.