OCRA

OCRA: (A) (R)ust (C)ache implementation using arrow-rs (O)bjectStore trait.

lib.rs:

OCRA: (A) (R)ust (C)ache implementation for arrow-rs (O)bjectStore.

It offers a few ObjectStore implementations that work with caches.

For example, you can use ReadThroughCache to wrap an existing ObjectStore instance with a PageCache.

use object_store::{ObjectStore, local::LocalFileSystem, path::Path};
use ocra::{ReadThroughCache, memory::InMemoryCache};

let fs = Arc::new(LocalFileSystem::new());
// Use 75% of system memory for cache
let memory_cache = Arc::new(
    InMemoryCache::with_sys_memory(0.75).build());
let cached_store: Arc<dyn ObjectStore> =
    Arc::new(ReadThroughCache::new(fs, memory_cache));

// Now you can use `cached_store` as a regular ObjectStore
let path = Path::from("my-key");
let data = cached_store.get_range(&path, 1024..2048).await.unwrap();