Download
hakrawler is a lightweight command-line web crawler built in Go that is designed to quickly discover URLs, endpoints, and assets within web applications. It is primarily used during the reconnaissance phase of security testing, bug bounty hunting, and penetration testing. It works by automatically crawling web pages and extracting links, JavaScript file locations, and other resources that may reveal additional attack surface or hidden functionality. hakrawler is implemented as a simple and efficient crawler using the Gocolly library, which allows it to perform fast and concurrent crawling of web pages. It accepts URLs through standard input, making it easy to integrate into command-line pipelines with other security tools. This workflow enables researchers to combine it with subdomain enumeration, HTTP probing, and vulnerability scanning utilities to automate reconnaissance processes. hakrawler can follow links within a website and optionally include subdomains.
Features
- Fast web crawling for discovering URLs and application endpoints
- Extracts links and JavaScript file locations from web pages
- Supports multithreaded crawling to improve performance
- Option to include subdomains during crawling scope
- Outputs results in plain text or JSON for automation pipelines
- Works well with command-line workflows and other reconnaissance tools
Project Samples
