x-ray
The next web scraper. See through the noise.
AI summary
Web scraper
A flexible web scraping framework for extracting data from websites with customizable selectors and pagination support.
- stars
- 5.9K
- forks
- 349
- watching
- 110
- awesome lists
- 3
Similar projects
Found by comparing what the projects do, not just their names.
Web scraper
A versatile web scraping module with two scrapers for static and dynamic content extraction.
apify/crawlee16.1K
Web scraper
A tool for building reliable web scraping and browser automation pipelines in Node.js.
scraper
A Node.js library and CLI tool for automating web page scraping and parsing
spatie/crawler2.6K
Crawler
A powerful web crawler written in PHP that can execute JavaScript and crawl multiple URLs concurrently.
Crawler
A distributed crawling framework that leverages Headless Chrome to scrape dynamic websites
s0md3v/photon11.1K
Crawler
A fast and flexible web crawler designed to gather information from the internet
unclecode/crawl4ai18.5K
Web crawler
A web crawling tool designed to extract structured data from the web for use in AI applications
Web scraper
A tool to extract data from web pages using various query languages and selectors.
Web scraper
A fast and flexible web scraping library using native libxml C bindings
Web scraper
A NodeJS-based web crawler and spider that extracts data from websites.
gocolly/colly23.4K
Website scraper
A framework for extracting structured data from websites in a fast and elegant way
Scraper
A Python-based social media scraper that extracts data from various platforms.
Crawler library
A high-level web crawling and scraping framework for Elixir.
Web page summary extractor
Extracts readable content from web pages using Open Graph and traditional readability rules.
News aggregator
A personal news reader application utilizing multiple technologies to fetch, parse, and store news articles.
Featured in 3 awesome lists
Each link jumps to the spot where the list mentions x-ray.
