1 unstable release

0.1.0 Aug 15, 2023

#12 in #crawl

Apache-2.0

13KB
223 lines

httpdir

This library provides an Iterator to crawl the list of files available through Index of HTTP url.


lib.rs:

This library provides an Iterator to crawl the list of files available through Index of HTTP url.

Here is an example usage:

use url::Url;
let url = Url::parse("http://localhost/logs/").unwrap();
let files: Vec<Url> = httpdir::list(url)?;

Or using the iterator:

for file in httpdir::Crawler::new().walk(url) {
   let file: Url = file?;
}

Dependencies

~5–21MB
~269K SLoC