1 unstable release
0.1.0 | Aug 15, 2023 |
---|
#12 in #crawl
13KB
223 lines
httpdir
This library provides an Iterator to crawl the list of files available through Index of HTTP url.
lib.rs
:
This library provides an Iterator to crawl the list of files available through Index of HTTP url.
Here is an example usage:
use url::Url;
let url = Url::parse("http://localhost/logs/").unwrap();
let files: Vec<Url> = httpdir::list(url)?;
Or using the iterator:
for file in httpdir::Crawler::new().walk(url) {
let file: Url = file?;
}
Dependencies
~5–21MB
~269K SLoC