#s3 #wasabi #minio #yandex #gcp

rust-s3

Rust library for working with Amazon S3 and compatible object storage APIs

103 releases (25 breaking)

new 0.27.0-rc4 Apr 11, 2021
0.27.0-beta9 Jan 9, 2021
0.27.0-beta8 Dec 29, 2020
0.27.0-beta1 Nov 18, 2020
0.2.3 Jul 8, 2016

#12 in Network programming

Download history 1440/week @ 2020-12-25 1499/week @ 2021-01-01 1806/week @ 2021-01-08 1630/week @ 2021-01-15 1893/week @ 2021-01-22 2136/week @ 2021-01-29 1921/week @ 2021-02-05 3224/week @ 2021-02-12 2835/week @ 2021-02-19 2281/week @ 2021-02-26 2619/week @ 2021-03-05 1575/week @ 2021-03-12 2138/week @ 2021-03-19 2269/week @ 2021-03-26 2511/week @ 2021-04-02 2207/week @ 2021-04-09

9,502 downloads per month
Used in less than 9 crates

MIT license

200KB
4K SLoC

build MIT licensed

rust-s3 [docs]

Rust library for working with Amazon S3 or arbitrary S3 compatible APIs, fully compatible with async/await and futures ^0.3

Support further development

  • BTC - 3QQdtQGSMStTWEBhe65hPiAWJekXH8n26o
  • ETH - 0x369Fd06ACc25CCfE0A28BE40018cF3aC38AcdcB6

Intro

Modest interface towards Amazon S3, as well as S3 compatible object storage APIs such as Wasabi, Yandex, Minio or Google Cloud Storage. Supports: put, get, list, delete, operations on tags and location, well as head.

Additionally a dedicated presign_get Bucket method is available. This means you can upload to s3, and give the link to select people without having to worry about publicly accessible files on S3. This also means that you can give people a PUT presigned URL, meaning they can upload to a specific key in S3 for the duration of the presigned URL.

AWS, Yandex and Custom (Minio) Example

Path or subdomain style URLs and headers

Bucket struct provides constructors for path-style paths, subdomain style is the default. Bucket exposes methods for configuring and accessing path-style configuration.

Buckets

create async
delete async

Presign

PUT presign_put
GET presign_get

GET

There are a few different options for getting an object. sync and async methods are generic over std::io::Write, while tokio methods are generic over tokio::io::AsyncWriteExt.

async get_object
async get_object_stream

PUT

Each GET method has a PUT companion sync and async methods are generic over std::io::Read. async stream methods are generic over futures::io::AsyncReadExt, while tokio methods are generic over tokio::io::AsyncReadExt.

async put_object
async put_object_with_content_type
async put_object_stream

List

async list

DELETE

async delete_object

Location

async location

Tagging

async put_object_tagging
async get_object_tagging

Head

async head_object

Usage (in Cargo.toml)

[dependencies]
rust-s3 = "0.27"

Features

Disable SSL verification for endpoints, useful for custom regions
[dependencies]
rust-s3 = {version = "0.26.0", features = ["no-verify-ssl"]}
Fail on HTTP error responses
[dependencies]
rust-s3 = {version = "0.26.0", features = ["fail-on-err"]}
Different SSL backends

Default is reqwest/native-tls, it is possible to switch to reqwest/rustls-tls which is more portable

[dependencies]
rust-s3 = {version = "0.26.0", features = ["rustls-tls"]}
Use async-std instead of tokio

By default the with-tokio feature is enabled. To switch to async-std you need to disable the default features and specify the with-async-std feature

[dependencies]
rust-s3 = {version = "0.27.0-beta8", features = ["with-async-std"], default-features = false}

Dependencies

~9–15MB
~314K SLoC