3 releases

Uses old Rust 2015

0.1.2 Jul 2, 2020
0.1.1 Dec 17, 2018
0.1.0 Oct 7, 2018

#33 in #pages

42 downloads per month

MIT license

17KB
82 lines

url-scraper

Rust crate for scraping URLs from HTML pages.

Example

extern crate url_scraper;
use url_scraper::UrlScraper;

fn main() {
    let directory = "http://phoronix.com/";

    let scraper = UrlScraper::new(directory).unwrap();
    for (text, url) in scraper.into_iter() {
        println!("{}: {}", text, url);
    }
}

lib.rs:

Simple library for quickly fetching a list of URLs from a webpage.

Example

extern crate url_scraper;
use url_scraper::UrlScraper;

let scraper = UrlScraper::new("http://phoronix.com/").unwrap();
for (text, url) in scraper.into_iter() {
    println!("{}: {}", text, url);
}

Dependencies

~19–28MB
~468K SLoC