7 releases
Uses new Rust 2024
0.1.2 | Jun 19, 2025 |
---|---|
0.1.1 | May 29, 2025 |
0.0.3 | May 27, 2025 |
#105 in HTTP client
513 downloads per month
88KB
565 lines
ASIMOV Apify Module
ASIMOV module for data import powered by the Apify web automation platform.
✨ Features
- Imports structured data from Apify actors (web automation scripts).
- Collects the raw JSON data via the Apify API (requires an API token).
- Constructs a semantic knowledge graph based on the KNOW ontology.
- Supports plain JSON output as well as RDF output in the form of JSON-LD.
- Distributed as a standalone static binary with zero runtime dependencies.
🛠️ Prerequisites
- Rust 1.85+ (2024 edition) if building from source code
⬇️ Installation
Installation from PyPI
pip install -U asimov-apify-module
Installation from RubyGems
gem install asimov-apify-module
Installation from NPM
npm install -g asimov-apify-module
Installation from Source Code
cargo install asimov-apify-module
👉 Examples
export APIFY_TOKEN="..."
Fetching Google Results
asimov-apify-fetcher https://www.google.com/search?q=Isaac+Asimov # JSON
asimov-apify-importer https://www.google.com/search?q=Isaac+Asimov # JSON-LD
Fetching X (Twitter) Followers
asimov-apify-fetcher https://x.com/apify/followers # JSON
asimov-apify-importer https://x.com/apify/followers # JSON-LD
Fetching X (Twitter) Followees
asimov-apify-fetcher https://x.com/apify/following # JSON
asimov-apify-importer https://x.com/apify/following # JSON-LD
Fetching LinkedIn Profile
asimov-apify-fetcher https://www.linkedin.com/in/sarptecimer # JSON
asimov-apify-importer https://www.linkedin.com/in/sarptecimer # JSON-LD
Fetching Instagram Profile
asimov-apify-fetcher https://www.instagram.com/humansofny # JSON
asimov-apify-importer https://www.instagram.com/humansofny # JSON-LD
⚙ Configuration
Environment Variables
APIFY_TOKEN
: (required) the Apify API token to use
📚 Reference
Installed Binaries
asimov-apify-fetcher
: collects JSON data from the Apify APIasimov-apify-importer
: collects and transforms JSON into JSON-LD
Supported Actors
Actor | URL Pattern | JSON | RDF |
---|---|---|---|
Google Search | https://www.google.com/search?q=:query |
✅ | ✅ |
X (Twitter) Followers | https://x.com/:account/followers |
✅ | ✅ |
X (Twitter) Followees | https://x.com/:account/following |
✅ | ✅ |
LinkedIn Profile | https://www.linkedin.com/in/:username |
✅ | 🚧 |
Instagram Profile | https://www.instagram.com/:username |
✅ | 🚧 |
👨💻 Development
git clone https://github.com/asimov-modules/asimov-apify-module.git
Dependencies
~16–29MB
~532K SLoC