17 unstable releases (7 breaking)
0.8.2 | Nov 23, 2024 |
---|---|
0.8.0 | Sep 19, 2024 |
0.7.0 | Jul 12, 2024 |
0.5.1 | Dec 8, 2023 |
0.2.0 | Jul 31, 2022 |
#601 in Web programming
2,786 downloads per month
Used in 5 crates
(4 directly)
55KB
1K
SLoC
reqwest streams for Rust
Library provides HTTP response streaming support for reqwest:
- JSON array stream format
- JSON lines stream format
- CSV stream
- Protobuf len-prefixed stream format
- Arrow IPC stream format
This type of responses are useful when you are reading huge stream of objects from some source (such as database, file, etc) and want to avoid huge memory allocation.
Quick start
Cargo.toml:
[dependencies]
reqwest-streams = { version = "0.7", features=["json", "csv", "protobuf", "arrow"] }
Example code:
use reqwest_streams::*;
use futures::stream::BoxStream;
use serde::{Deserialize, Serialize};
#[derive(Debug, Clone, Deserialize)]
struct MyTestStructure {
some_test_field: String
}
#[tokio::main]
async fn main() -> Result<(), Box<dyn std::error::Error>> {
let _stream = reqwest::get("http://localhost:8080/json-array")
.await?
.json_array_stream::<MyTestStructure>(1024);
Ok(())
}
All examples available in examples directory.
To run example use:
# cargo run --example json-stream
Need server support?
There is the same functionality:
Licence
Apache Software License (ASL)
Author
Abdulla Abdurakhmanov
Dependencies
~6–20MB
~267K SLoC