3 releases
0.1.3 | Aug 21, 2021 |
---|---|
0.1.2 | Aug 15, 2021 |
0.1.1 | Aug 13, 2021 |
#589 in HTTP client
31KB
426 lines
shirodl
ShiroDL is an Async Download Library for Massive Batch of Urls Downloading
Install
cargo install --example shirodl --git https://github.com/Oyami-Srk/shirodl
Usage
shirodl --help
for usage helps.
Library
example
use shirodl::Downloader;
use std::path::PathBuf;
fn main() {
let mut dler = Downloader::new();
dler.set_destination(PathBuf::from("."));
dler.set_hash_check(true);
dler.append_task(
"https://avatars.githubusercontent.com/u/6939913?s=48&v=4".to_string(),
PathBuf::from("."),
None,
);
let result = dler.download(|_, _, _, _| {});
for r in result {
println!("Failed: {}, due to {:?}", r.url, r.err);
}
}
Downloader::download will create Tokio
runtime, so you can call it directly in normal sync code.
Default Download parameters:
folder: Default::default(),
timeout: Some(Duration::from_secs(10)),
headers: HeaderMap::new(),
hash_check: false,
only_binary: true,
auto_rename: true,
Notice that currently auto-rename only determinates extensions simply by MIME via http header content-type
and extracts subtype
as extension.
Manually check is required but at least it could give you a tip.
shirodl::Error::ignorable()
is not always ignorable, present errors to users always and leave the decisions to end user.
Dependencies
~12–26MB
~421K SLoC