katana
Crawler
A fast and configurable web crawling framework that can be used to automate tasks in pipelines.
A next-generation crawling and spidering framework.
12k stars
91 watching
615 forks
Language: Go
last commit: 3 days ago
Linked from 1 awesome list
clicrawlergocrawlerheadlessspider-frameworkweb-spider
vavkamil/awesome-bugbounty-toolsRelated projects:
| Repository | Description | Stars |
|---|---|---|
 jaeles-project/gospider | A tool for web crawling and exploitation written in Go. | 2,578 |
 yujiosaka/headless-chrome-crawler | A distributed crawling framework that leverages Headless Chrome to scrape dynamic websites | 5,527 |
 azure/cloud-katana | Automates security assessment and research in cloud-native environments using event-driven serverless computing | 250 |
 spatie/crawler | A powerful web crawler written in PHP that can execute JavaScript and crawl multiple URLs concurrently. | 2,537 |
 grafana/tanka | A configuration framework for Kubernetes clusters | 2,396 |
 shpota/goxygen | Automates the creation of web projects with Go and various front-end frameworks and databases. | 3,522 |
 webdriverio/webdriverio | A test automation framework for end-to-end and unit testing in browsers and mobile devices using WebDriver technology | 9,074 |
| grafana/pyroscope | A platform that helps you identify and debug performance issues in your applications | 10,099 |
 spinnaker/spinnaker | A platform for managing software releases across multiple cloud environments in a safe and efficient manner. | 9,341 |
 internetarchive/heritrix3 | A web crawler designed to collect and preserve digital artifacts while respecting site policies and load constraints. | 2,833 |
 bda-research/node-crawler | A NodeJS-based web crawler and spider that extracts data from websites. | 6,704 |
 kataras/iris | A fast and feature-rich web framework for Go that provides a simple yet powerful foundation for building websites and APIs. | 25,267 |
 gohugoio/hugo | A fast and flexible tool for generating static websites with built-in support for various content formats. | 75,938 |
 bowser-js/bowser | A small JavaScript library used to detect and analyze browser properties. | 5,496 |
 geziyor/geziyor | A fast and flexible web crawling and scraping framework for extracting structured data from websites. | 2,629 |