#meta #extract #metadata #information #website #page #metatags

metascraper

MetaScraper is a extracts metadata information of a website

4 releases

0.2.2 Jan 11, 2023
0.2.1 Dec 26, 2022
0.2.0 Dec 26, 2022
0.1.0 Dec 25, 2022

#47 in #meta

MIT license

13KB
193 lines

MetaScraper

Rust crates.io Released API docs MIT licensed

MetaScraper is a extracts metadata information of a website.

MetaScraper uses tl as its html parser. This choice was made because tl was the fastest in benchmark tests. For more information, visit the parse_query_bench GitHub page.

Usage

let input = include_str!("test.html");
let metascraper = MetaScraper::parse(input).unwrap();
println!("{}", metascraper.title().unwrap());
// Title
let metadata = metascraper.metadata();
println!("{:?}", metadata);
// MetaData {
//     title: Some("Title"),
//     description: Some("Description"),
//     canonical: Some("https://mehmetcan.sahin.dev"),
//     language: Some("en"),
//     rss: Some("rss.xml"),
//     metatags: Some([
//         Metatag { name: "X-UA-Compatible", content: "IE=edge" },
//         Metatag { name: "viewport", content: "width=device-width, initial-scale=1.0" },
//         Metatag { name: "description", content: "Description" }
//         ])
// }

License

MetaScraper is licensed under the MIT License.

Dependencies

~145KB