gau
URL fetcher
Fetches known URLs from various web archiving services
Fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl.
4k stars
50 watching
456 forks
Language: Go
last commit: 4 months ago
Linked from 1 awesome list
alienvaultgauhacktoberfestsecuritywayback-machine
vavkamil/awesome-bugbounty-toolsRelated projects:
| Repository | Description | Stars |
|---|---|---|
 owainlewis/http-dispatch | A high-level HTTP client library with an easy-to-use API and transparent HTTPS support. | 62 |
 therook/subbrute | A tool for automating the discovery of subdomains and DNS records by using open resolvers as a proxy to circumvent rate limiting. | 3,372 |
 posener/client-timing | An HTTP client library that enables automatic timing of requests and propagation through servers. | 24 |
 edoverflow/can-i-take-over-xyz | A resource to guide security researchers on identifying subdomain takeover vulnerabilities in web services. | 4,913 |
 tomnomnom/httprobe | Tool for probing multiple domains for working HTTP and HTTPS servers | 2,902 |
 symfony/http-client | A component for fetching HTTP resources in PHP | 1,960 |
 didip/tollbooth | Middleware to control HTTP request rates based on various criteria such as IP address, path, methods, and headers. | 2,717 |
 apache/httpcomponents-client | A Java-based client for making HTTP requests using a modular and customizable design | 1,466 |
 nahi/httpclient | A Ruby HTTP client library providing basic HTTP request functionality with features like authentication and streaming support. | 703 |
 prom-client-net/prom-client-httprequestdurations | Provides a way to measure HTTP request durations in a .NET application. | 10 |
 qustavo/httplab | An interactive web server for inspecting and manipulating HTTP requests and responses | 4,057 |
 pubsubhubbub/pubsubhubbub | An open protocol enabling decoupled publish/subscribe communication on the Internet | 604 |
 fanux/lhttp | A WebSocket-based protocol for building scalable IM services without XMPP | 691 |
| apache/serf | A high-performance asynchronous HTTP client library with minimal memory copies and transformations. | 27 |
 ddo/rq | A nicer interface for golang stdlib HTTP client | 52 |