katana
Crawler
A fast and configurable web crawling framework that can be used to automate tasks in pipelines.
A next-generation crawling and spidering framework.
13k stars
94 watching
656 forks
Language: Go
last commit: 11 months ago
Linked from 1 awesome list
clicrawlergocrawlerheadlessspider-frameworkweb-spider
vavkamil/awesome-bugbounty-toolsRelated projects:
| Repository | Description | Stars |
|---|---|---|
 jaeles-project/gospider | A tool for web crawling and exploitation written in Go. | 2,598 |
 yujiosaka/headless-chrome-crawler | A distributed crawling framework that leverages Headless Chrome to scrape dynamic websites | 5,534 |
 azure/cloud-katana | Automates security assessment and research in cloud-native environments using event-driven serverless computing | 250 |
 spatie/crawler | A powerful web crawler written in PHP that can execute JavaScript and crawl multiple URLs concurrently. | 2,552 |
 grafana/tanka | A configuration framework for Kubernetes clusters | 2,429 |
 shpota/goxygen | Automates the creation of web projects with Go and various front-end frameworks and databases. | 3,531 |
 webdriverio/webdriverio | A test automation framework for end-to-end and unit testing in browsers and mobile devices using WebDriver technology | 9,115 |
| grafana/pyroscope | A platform that helps you identify and debug performance issues in your applications | 10,178 |
 spinnaker/spinnaker | A platform for managing software releases across multiple cloud environments in a safe and efficient manner. | 9,366 |
 internetarchive/heritrix3 | A web crawler designed to collect and preserve digital artifacts while respecting site policies and load constraints. | 2,857 |
 bda-research/node-crawler | A NodeJS-based web crawler and spider that extracts data from websites. | 6,718 |
 kataras/iris | A fast and feature-rich web framework for building scalable and efficient web applications in Go. | 25,289 |
 gohugoio/hugo | A fast and flexible tool for generating static websites with built-in support for various content formats. | 76,514 |
 bowser-js/bowser | A small JavaScript library used to detect and analyze browser properties. | 5,517 |
 geziyor/geziyor | A fast and flexible web crawling and scraping framework for extracting structured data from websites. | 2,646 |