#hacker-news #comments #quickly #stores #grab #stories #polls

app hncat

Grab all Hacker News stores + comments, quickly

4 releases

0.1.3 May 15, 2021
0.1.2 May 15, 2021
0.1.1 May 12, 2021
0.1.0 May 12, 2021

#10 in #stories

MIT license

19KB
265 lines

hncat 🐈

Crates.io Actions Status

Dump all comments, stories and polls from Hacker News fast.

Table of Contents

Install 💿

  • Homebrew: brew install orf/brew/hncat
  • Cargo: cargo install hncat

Usage 🎷

Running hncat will begin to stream all items from the API to stdout in JSON.

$ hncat --help
hncat 0.1.0
Grab Hacker News items from the API in parallel.

USAGE:
    hncat [OPTIONS]

FLAGS:
    -h, --help       Prints help information
    -V, --version    Prints version information

OPTIONS:
        --concurrency <concurrency>    Make this many concurrent requests [default: 200]
        --end-date <end-date>          Ignore all items created after this date. Supports relative durations like "1
                                       hour" as well as absolute rfc3339 dates
        --last <last>                  Fetch the last X items
        --limit <limit>                Limit the number of outputted rows to this
        --since <since>                Fetch all records since this time. Supports relative durations like "1 hour"
        --start-date <start-date>      Ignore all items created before this date. Supports relative durations like "1
                                       hour" as well as absolute rfc3339 dates
        --start-id <start-id>          Fetch records with IDs higher than this
        --stop-id <stop-id>            Fetch records with IDs lower than this

Dependencies

~13–27MB
~445K SLoC