3 releases
Uses old Rust 2015
0.1.2 | Jul 2, 2020 |
---|---|
0.1.1 | Dec 17, 2018 |
0.1.0 | Oct 7, 2018 |
#36 in #pages
42 downloads per month
17KB
82 lines
url-scraper
Rust crate for scraping URLs from HTML pages.
Example
extern crate url_scraper;
use url_scraper::UrlScraper;
fn main() {
let directory = "http://phoronix.com/";
let scraper = UrlScraper::new(directory).unwrap();
for (text, url) in scraper.into_iter() {
println!("{}: {}", text, url);
}
}
lib.rs
:
Simple library for quickly fetching a list of URLs from a webpage.
Example
extern crate url_scraper;
use url_scraper::UrlScraper;
let scraper = UrlScraper::new("http://phoronix.com/").unwrap();
for (text, url) in scraper.into_iter() {
println!("{}: {}", text, url);
}
Dependencies
~19–27MB
~468K SLoC