2 releases
0.1.1 | Apr 24, 2024 |
---|---|
0.1.0 | Apr 23, 2024 |
#422 in HTTP client
40 downloads per month
17KB
192 lines
Retriever
A rust library for downloading files from the web. You can download multiple files asyncronously. The library is built on top of reqwest and tokio. It also utilizes indicatif for progress bars.
Examples
Multiple examples are available in src/lib.rs
Single file download
use reqwest::Client;
use file_retriever::{self, RetrieverBuilder};
use tokio::fs::OpenOptions;
#[tokio::main]
async fn main() -> Result<()> {
let retriever = RetrieverBuilder::new()
.show_progress(false)
.workers(1)
.build();
let request = Client::new()
.get("https://example.com")
.build()
.unwrap();
let output_file = OpenOptions::new()
.create(true)
.write(true)
.truncate(true)
.open("/tmp/test")
.await
.unwrap();
let _ = retriever.download_file(request, output_file).await;
}
Multiple file download
Example of downloading multiple files can be seen in the multi_download_example.rs
You can run example with:
cargo run --example multi_download_example -- -i ./examples/in/ -o ./examples/out/
Tests
You can execute tests with:
cargo test --lib
which will create fetch files from mock server to /tmp/
directory
Dependencies
~9–20MB
~261K SLoC