#fetch #pages #web-page #utf-8 #non #encoding

yanked http-fetch

Fetch web pages easily (supports compression and non UTF-8 encodings)

Uses old Rust 2015

0.2.1 Aug 6, 2016

#24 in #non

MIT/Apache

8KB
112 lines

http-fetch

Build Status

A small Rust library to fetch web pages.

let body = fetch_page(url); // fetch the response body of the given URL as String

Development

When running on OS X with a homebrew installed openssl version, make sure to pass on the correct paths to cargo to build:

env OPENSSL_INCLUDE_DIR=/usr/local/opt/openssl/include DEP_OPENSSL_INCLUDE=/usr/local/opt/openssl/include cargo test

License

Licensed under either of

Contribution

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.

Dependencies

~8MB
~170K SLoC