5 stable releases

2.0.0 Aug 6, 2021
1.1.0 Dec 30, 2020
1.0.2 Nov 23, 2020
1.0.0 Nov 22, 2020

#471 in Machine learning

Apache-2.0

7KB
59 lines

Dense

Crates.io lib.rs.io docs

An encoder/decoder to/from dense files.

A file format simpler and denser than MNIST, a dense file is binary file of sequential training examples and nothing else (example->label->example->label->etc.).

MNIST Testing data

Format Size Size on disk
MNIST 7,850,024 7,856,128
Dense 7,850,000 7,852,032

Example

use ndarray::{Array2,array};

let data: Array2<u8> = array![[0, 0], [1, 0], [0, 1], [1, 1]];
let labels: Array2<u16> = array![[0], [1], [1], [0]];

dense::write("dense_reader",&data,&labels).unwrap();

let (read_data,read_labels) = dense::read::<u8,u16>("dense_reader",2).unwrap();

assert_eq!(read_data,data);
assert_eq!(read_labels,labels);

Dependencies

~1.5MB
~28K SLoC