#scrape #crawl #results #requests #generate #data-structures #http

crawl-rs

Crawl-rs allows you to generate async Http requests, and scrape the results directly into a custom datastructure

1 unstable release

Uses old Rust 2015

0.0.1 Mar 30, 2018

#14 in #crawl

MIT license

3KB

Crawl-rs

An Rust library to crawl and scrape the web.

This is just a Proof Of Concept for now. Don't consider trying to use it at least until 0.1 is out.

No runtime deps