#scrape #crawl #data-structures #results #requests #generate #http

crawl-rs

Crawl-rs allows you to generate async Http requests, and scrape the results directly into a custom datastructure

1 unstable release

Uses old Rust 2015

0.0.1 Mar 30, 2018

#12 in #crawl

MIT license

3KB

Crawl-rs

An Rust library to crawl and scrape the web.

This is just a Proof Of Concept for now. Don't consider trying to use it at least until 0.1 is out.

No runtime deps