Photon
by s0md3v
Incredibly fast crawler designed for OSINT.
AI summary
Crawler
A fast and flexible web crawler designed to gather information from the internet
- stars
- 11.1K
- forks
- 1.5K
- watching
- 323
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
unclecode/crawl4ai18.5K
Web crawler
A web crawling tool designed to extract structured data from the web for use in AI applications
gocolly/colly23.4K
Website scraper
A framework for extracting structured data from websites in a fast and elegant way
Crawler
A tool for automatically discovering and crawling web application endpoints and assets
apify/crawlee16.1K
Web scraper
A tool for building reliable web scraping and browser automation pipelines in Node.js.
Crawler
A distributed crawling framework that leverages Headless Chrome to scrape dynamic websites
Crawler
A web crawler designed to collect and preserve digital artifacts while respecting site policies and load constraints.
Dark web crawler
An OSINT tool for exploring and analyzing dark web sites using Tor network
Web scraper
A flexible web scraping framework for extracting data from websites with customizable selectors and pagination support.
Crawler
A tool for web crawling and exploitation written in Go.
Web testing tool
A Python test framework for automating web applications using Selenium and other tools.
spatie/crawler2.6K
Crawler
A powerful web crawler written in PHP that can execute JavaScript and crawl multiple URLs concurrently.
finic-ai/finic2.3K
Browser service
Provides cloud-hosted browsers for automation and scraping tasks to avoid detection by websites.
TLS scanner
An SSL/TLS scanning tool and Python library for assessing server security configurations
smicallef/spiderfoot13.4K
Information collector
Automates information gathering and analysis from various data sources to support threat intelligence and cybersecurity efforts
geziyor/geziyor2.6K
crawler
A fast and flexible web crawling and scraping framework for extracting structured data from websites.
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions Photon.
