#lz4 #format #block #github #compatible #standard

lz4jb

A Rust implementation of the LZ4BlockOutputStream format from https://github.com/lz4/lz4-java. This is not compatible with the standard LZ4 Block format

1 unstable release

0.1.0 Aug 28, 2021

#611 in Compression

MIT license

39KB
887 lines

lz4jb

A streaming compression/decompression library which implements the LZ4BlockOutputStream format from lz4-java.

Beware: this format is not compatible with the standard LZ4 Block format. You should not use it unless you have some historical data compressed using the Java code.

This repository contains:

  • lz4jb: a library which implements the Read and Write traits,
  • a command line tool to compress/decompress data in this format. The parameters are similar to gzip,

Compression

Lz4BlockOutput is a wrapper around a type which implements the Write trait.

use lz4jb::Lz4BlockOutput;
use std::io::Write;

fn main() -> std::io::Result<()> {
    let mut output = Vec::new(); // Vec<u8> implements the Write trait
    Lz4BlockOutput::new(&mut output, 64)?
        .write_all("...".as_bytes())?;
    println!("{:?}", output);
    Ok(())
}

Decompression

Lz4BlockInput is a wrapper around a type which implements the Read trait.

use lz4jb::Lz4BlockInput;
use std::io::Read;

const D: [u8; 24] = [
    76, 90, 52, 66, 108, 111, 99, 107, 16, 3, 0, 0, 0, 3, 0, 0, 0, 82, 228, 119, 6, 46, 46, 46,
];

fn main() -> std::io::Result<()> {
    let mut output = String::new();
    Lz4BlockInput::new(&D[..]) // &[u8] implements the Read trait
        .read_to_string(&mut output)?;
    println!("{}", output);
    Ok(())
}

Command line

In the cli folder, there is a command line tool to compress and decompress using this library.

$ cargo install cli
...
$ lz4jb -h
lz4jb 0.1.0
A compression tool which implements the LZ4BlockOutputStream format from https://github.com/lz4/lz4-java.
This is not compatible with the standard LZ4 Block format.

USAGE:
    lz4jb [FLAGS] [OPTIONS] [file]...

FLAGS:
    -z, --compress      Compress. This is the default operation mode.
    -d, --decompress    Decompress. [aliases: uncompress]
    -f, --force         Force the compression or decompression.
    -h, --help          Prints help information
    -k, --keep          Keep (don't delete) input files during compression or decompression.
    -l, --list          Test the integrity of compressed files.
    -c, --stdout        Write output on standard output; keep original files unchanged.
    -t, --test          Test the integrity of compressed files.
    -V, --version       Prints version information

OPTIONS:
    -b, --blocksize <blocksize>    Block size for compression in bytes (between 64 and 33554432).
    -S, --suffix <suffix>          Append this suffix instead of the default .lz4 for compression.

ARGS:
    <file>...    Sets the input file to use.

License

See the LICENCE file.

Dependencies

~315KB