Sub_Crawler 🌐🔍

Overview

Sub_Crawler is a fast and flexible subdomain enumeration tool designed to help security researchers, penetration testers, and network administrators discover subdomains of a target domain quickly and efficiently.

Features

• 🚀 High-Performance: Multithreaded scanning for rapid subdomain discovery
• 📋 Flexible Wordlists: Multiple built-in wordlist options
• 🔧 Customizable: Support for custom wordlists and thread configurations
• 🎯 Easy to Use: Simple command-line interface

Prerequisites

• Rust programming language (latest stable version recommended)
• Optional: SecLists wordlist collection

Installation

From Source

1. Clone the repository:

git clone https://github.com/sylar-my/sub_crawler.git
cd sub_crawler

2. Build the project:

cargo build --release

3. Install the binary:

cargo install --path .

Binary Release

Download the latest release from the Releases page.

Usage

Basic Scanning

sub_crawler example.com

Advanced Options

# Use top 5000 wordlist with 20 threads
sub_crawler -w top5000 -t 20 example.com

# Use a custom wordlist
sub_crawler -w custom -c /path/to/custom_wordlist.txt example.com

Wordlist Options

• light: Default lightweight wordlist
• top5000: Top 5000 most common subdomain names
• top20000: Extended subdomain list
• top110000: Comprehensive subdomain collection
• custom: User-provided custom wordlist

Configuration

Environment Variable

Set the SecLists path:

export SECLISTS_PATH=/path/to/seclists

Command Line Options

Contributing

1. Fork the repository
2. Create your feature branch (git checkout -b feature/AmazingFeature)
3. Commit your changes (git commit -m 'Add some AmazingFeature')
4. Push to the branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

License

Distributed under the MIT License. See LICENSE for more information.

Contact

Project Link: https://github.com/sylar-my/sub_crawler

Acknowledgments

• SecLists
• Rust Community