18 releases

0.5.5 May 4, 2021
0.5.4 Mar 3, 2021
0.5.3 Dec 16, 2020
0.3.9 Sep 17, 2020
0.1.2 Feb 27, 2020

#1138 in Data structures

Download history 4/week @ 2024-12-10 3/week @ 2025-02-11 4/week @ 2025-02-18

69 downloads per month
Used in 2 crates

Custom license

145KB
3.5K SLoC

Point Cloud

Abstracts data access over several files and glues metadata files to vector data files


Point Cloud

A dataset access layer that allows for metadata to be attached to points. Used for goko. Currently this accelerates distance calculations with a set of packed_simd accelerated norms and a rayon threadpool while abstracting the access of the datapoints across multiple data files. It's structured in such a way that adding formats should be easy.

Planned Features

Current work

  • Benchmarks.
  • PCA, & Gaussian calculators.

Near Future

  • Cleanup of the metadata feature in pointcloud
  • Sparse accessors and sparse databacking

Future

  • Network interface for distributed datasets.
  • Image file abstraction for applications like imagenet.
  • Asynchronous access for the network and file accessors.

Dependencies

~8.5MB
~153K SLoC