gospider
Gospider - Fast web spider written in Go
AI summary
Crawler
A tool for web crawling and exploitation written in Go.
- stars
- 2.6K
- forks
- 315
- watching
- 50
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Crawler
A tool for automatically discovering and crawling web application endpoints and assets
gocolly/colly23.4K
Website scraper
A framework for extracting structured data from websites in a fast and elegant way
Link crawler
A tool to crawl websites by exploring links recursively with support for JavaScript rendering.
gohugoio/hugo76.5K
Website generator
A fast and flexible tool for generating static websites with built-in support for various content formats.
gopherjs/gopherjs12.8K
Go compiler
Compiles Go code to JavaScript for running in browsers
Crawler
A modular, concurrent web crawler framework written in Go.
oj/gobuster10.3K
Brute-force tool
A tool for automating the discovery of vulnerabilities in web applications and services by brute-forcing various types of inputs
Crawler
A fast and configurable web crawling framework that can be used to automate tasks in pipelines.
astaxie/bat2.6K
HTTP client
A command-line tool that allows users to interact with HTTP servers in a human-friendly way.
crawler proxy
intercepts requests from web crawlers and proxies them to a prerendering service for rendering HTML
smicallef/spiderfoot13.4K
Information collector
Automates information gathering and analysis from various data sources to support threat intelligence and cybersecurity efforts
Web Crawler
A web crawler designed to crawl websites while obeying robots.txt rules, rate limits and concurrency limits, with customizable content handlers for parsing and processing crawled pages.
wailsapp/wails25.9K
Desktop app builder
Enables Go programmers to build desktop applications with integrated web frontends
geziyor/geziyor2.6K
crawler
A fast and flexible web crawling and scraping framework for extracting structured data from websites.
s0rg/crawley268
Web URL extractor
A utility for systematically extracting URLs from web pages and printing them to the console.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions gospider.
