gospider
Crawler
A tool for web crawling and exploitation written in Go.
Gospider - Fast web spider written in Go
3k stars
50 watching
313 forks
Language: Go
last commit: 8 months ago
Linked from 1 awesome list
bugbountycrawlergogospiderspider
vavkamil/awesome-bugbounty-toolsRelated projects:
| Repository | Description | Stars |
|---|---|---|
 hakluke/hakrawler | A tool for automatically discovering and crawling web application endpoints and assets | 4,514 |
 gocolly/colly | A framework for extracting structured data from websites in a fast and elegant way | 23,387 |
 iamstoxe/urlgrab | A tool to crawl websites by exploring links recursively with support for JavaScript rendering. | 330 |
 gohugoio/hugo | A fast and flexible tool for generating static websites with built-in support for various content formats. | 76,113 |
 gopherjs/gopherjs | Compiles Go code to JavaScript for running in browsers | 12,771 |
 hu17889/go_spider | A modular, concurrent web crawler framework written in Go. | 1,828 |
 oj/gobuster | A tool for automating the discovery of vulnerabilities in web applications and services by brute-forcing various types of inputs | 10,247 |
 projectdiscovery/katana | A fast and configurable web crawling framework that can be used to automate tasks in pipelines. | 12,276 |
 astaxie/bat | A command-line tool that allows users to interact with HTTP servers in a human-friendly way. | 2,551 |
 veliovgroup/spiderable-middleware | intercepts requests from web crawlers and proxies them to a prerendering service for rendering HTML | 39 |
 smicallef/spiderfoot | Automates information gathering and analysis from various data sources to support threat intelligence and cybersecurity efforts | 13,278 |
 brendonboshell/supercrawler | A web crawler designed to crawl websites while obeying robots.txt rules, rate limits and concurrency limits, with customizable content handlers for parsing and processing crawled pages. | 380 |
 wailsapp/wails | Enables Go programmers to build desktop applications with integrated web frontends | 25,498 |
 geziyor/geziyor | A fast and flexible web crawling and scraping framework for extracting structured data from websites. | 2,639 |
 s0rg/crawley | A utility for systematically extracting URLs from web pages and printing them to the console. | 265 |