#pages #web-page #utf-8 #compression #non #encoding

fetch

Fetch web pages easily (supports compression and non UTF-8 encodings)

5 releases (3 breaking)

Uses old Rust 2015

0.7.2 Oct 15, 2016
0.7.1 Oct 15, 2016
0.6.0 Oct 15, 2016
0.5.0 Oct 15, 2016
0.4.0 Aug 6, 2016

#13 in #non

MIT/Apache

9KB
125 lines

fetch

Build Status

Documentation

A small Rust library to fetch web pages.

extern crate fetch;

fn main() {
    let body = fetch::fetch_body("https://www.rust-lang.org/en-US/"); // fetch the response body of the given URL as String
}

Development

When running on OS X with a homebrew installed openssl version, make sure the correct paths are passed to cargo. See the scripts folder for details.

License

Licensed under either of

Contribution

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.

Dependencies

~8MB
~170K SLoC