#cache #update #path #generic #data #disk

generic_filesystem_cache

a cache for slow-to-compute information based on the state of on-disk objects. Includes capability to update entries based on the last-modified-time attribute

1 unstable release

0.1.0 Oct 30, 2021

#1644 in Filesystem


Used in 2 crates (via video_hash_filesystem_cac…)

MIT/Apache

19KB
375 lines

Generic Filesystem Cache

A small rust library for caching slow-to-compute data based on hard drive contents. Given a set of starting paths and a 'processing function' supplied by you, this library will recursively scan the filesystem from those starting paths and apply the processing function to each file.

The cache will save cached data to disk at a path given by you whenever a set number of changes has occurred inside the cache.

When directed by you, the cache will update itself if the 'modification time' of any cached file is changed.

Features

  • Supports Parallel loading (through rayon)
  • Will cache any serializable type

License

Licensed under either of

at your option.

Contribution

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.

Dependencies

~0.6–1.3MB
~30K SLoC