5 stable releases
2.0.0 | Aug 6, 2021 |
---|---|
1.1.0 | Dec 30, 2020 |
1.0.2 | Nov 23, 2020 |
1.0.0 | Nov 22, 2020 |
#500 in Machine learning
7KB
59 lines
Dense
An encoder/decoder to/from dense files.
A file format simpler and denser than MNIST, a dense file is binary file of sequential training examples and nothing else (example->label->example->label->etc.).
MNIST Testing data
Format | Size | Size on disk |
---|---|---|
MNIST | 7,850,024 | 7,856,128 |
Dense | 7,850,000 | 7,852,032 |
Example
use ndarray::{Array2,array};
let data: Array2<u8> = array![[0, 0], [1, 0], [0, 1], [1, 1]];
let labels: Array2<u16> = array![[0], [1], [1], [0]];
dense::write("dense_reader",&data,&labels).unwrap();
let (read_data,read_labels) = dense::read::<u8,u16>("dense_reader",2).unwrap();
assert_eq!(read_data,data);
assert_eq!(read_labels,labels);
Dependencies
~1.5MB
~28K SLoC