Lib.rs

› Command line utilities

#crawler #web #xodus

xodus

a simple web crawler in rust

Owned by Spirizeon.

Install
API reference
Source
Repository link

1 unstable release

0.1.0	Jul 13, 2024

#63 in #crawler

MIT license

2KB

exodus

simple web crawler in rust

No runtime deps

See also: spider, spider-cloud-cli, spider_worker, spider-client, spider_cli, coma, spider_transformations, web-crawler, capp, website_crawler, spider_utils

Lib.rs is an unofficial list of Rust/Cargo crates, created by kornelski. It contains data from multiple sources, including heuristics, and manually curated data. Content of this page is not necessarily endorsed by the authors of the crate. This site is not affiliated with nor endorsed by the Rust Project. If something is missing or incorrect, please file a bug.