2 releases

0.1.1 Jun 28, 2020
0.1.0 Jun 27, 2020

#195 in Database implementations

MIT license

16KB
266 lines

fs_scraper

fs_scraper is a web scraper for FjalorShqip.

Install the cli tool

Prerequirements:

  • Install cargo on your machine
  • Add ~/.cargo/bin to your path

If you already have cargo installed and added to the path then you can install fs_scraper by running the following command.

cargo install fs_scraper

Example usage

Search for a single query (The query should be at least two characters long).

fs_scraper -q fjalor

Scrape the whole database and save the data as json in a fjalorshqip.json

fs_scraper -s -o fjalorshqip.json -j

Show app usage for more flags and options

fs_scraper --help

Dependencies

~0–12MB
~126K SLoC