headless-chrome-crawler
by yujiosaka
Distributed crawler powered by Headless Chrome
AI summary
Crawler
A distributed crawling framework that leverages Headless Chrome to scrape dynamic websites
- stars
- 5.5K
- forks
- 407
- watching
- 116
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
apify/crawlee16.1K
Web scraper
A tool for building reliable web scraping and browser automation pipelines in Node.js.
Chrome runner
Provides a scaffold for running headless Chrome in AWS Lambda serverless functions.
Web scraper
A NodeJS-based web crawler and spider that extracts data from websites.
puppeteer/puppeteer89.1K
Browser automation library
An API to control Chrome and Firefox browsers programmatically
Web Crawler
A web crawler designed to crawl websites while obeying robots.txt rules, rate limits and concurrency limits, with customizable content handlers for parsing and processing crawled pages.
xtuhcy/gecco2.5K
Web Crawler Framework
A lightweight web crawler framework that enables easy extraction of web page data using jQuery-like selectors and supports asynchronous requests and distributed crawling.
spatie/crawler2.6K
Crawler
A powerful web crawler written in PHP that can execute JavaScript and crawl multiple URLs concurrently.
code4craft/webmagic11.5K
crawler
A framework for building scalable web crawlers in Java.
crawler proxy
intercepts requests from web crawlers and proxies them to a prerendering service for rendering HTML
gocolly/colly23.4K
Website scraper
A framework for extracting structured data from websites in a fast and elegant way
Headless Browser API
A .NET API for controlling Headless Chrome instances programmatically
Chrome emulator
A Java library that provides a headless Chrome browser solution for automation and testing purposes.
unclecode/crawl4ai18.5K
Web crawler
A web crawling tool designed to extract structured data from the web for use in AI applications
Browser automation tool
A PHP library to control and automate Chrome in headless mode
Web crawler
A Java-based web crawler for extracting and processing web page content
Featured in 1 awesome list
Each link jumps to the spot where the list mentions headless-chrome-crawler.
