#object #google-cloud #object-storage #cloud-storage #cloud #apache-arrow #storage

object_store

A generic object store interface for uniformly interacting with AWS S3, Google Cloud Storage, Azure Blob Storage and local files

20 releases (10 breaking)

new 0.10.0 Apr 22, 2024
0.9.1 Mar 5, 2024
0.9.0 Jan 8, 2024
0.8.0 Nov 6, 2023
0.3.0 Jun 14, 2022

#1 in #cloud

Download history 89201/week @ 2024-01-02 94552/week @ 2024-01-09 113847/week @ 2024-01-16 115918/week @ 2024-01-23 128068/week @ 2024-01-30 130663/week @ 2024-02-06 131498/week @ 2024-02-13 143536/week @ 2024-02-20 153222/week @ 2024-02-27 150130/week @ 2024-03-05 144726/week @ 2024-03-12 143520/week @ 2024-03-19 138884/week @ 2024-03-26 142489/week @ 2024-04-02 142453/week @ 2024-04-09 156240/week @ 2024-04-16

605,811 downloads per month
Used in 220 crates (99 directly)

MIT/Apache

1MB
17K SLoC

Rust Object Store

A focused, easy to use, idiomatic, high performance, async object store library for interacting with object stores.

Using this crate, the same binary and code can easily run in multiple clouds and local test environments, via a simple runtime configuration change. Supported object stores include:

Originally developed by InfluxData and later donated to Apache Arrow.

See docs.rs for usage instructions

Support for wasm32-unknown-unknown target

It's possible to build object_store for the wasm32-unknown-unknown target, however the cloud storage features aws, azure, gcp, and http are not supported.

cargo build -p object_store --target wasm32-unknown-unknown

Dependencies

~7–22MB
~339K SLoC