grab
by lorien
Web Scraping Framework
AI summary
Web scraper
A Python framework for asynchronous web scraping and crawling with a flexible network backend.
- stars
- 2.4K
- forks
- 274
- watching
- 89
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
Web scraper
A versatile web scraping module with two scrapers for static and dynamic content extraction.
gocolly/colly23.4K
Website scraper
A framework for extracting structured data from websites in a fast and elegant way
apify/crawlee16.1K
Web scraper
A tool for building reliable web scraping and browser automation pipelines in Node.js.
Web scraper
A flexible web scraping framework for extracting data from websites with customizable selectors and pagination support.
hugapi/hug6.9K
API framework
A Python framework for building simple and efficient APIs
scraper
A Node.js library and CLI tool for automating web page scraping and parsing
unclecode/crawl4ai18.5K
Web crawler
A web crawling tool designed to extract structured data from the web for use in AI applications
apiaryio/dredd4.2K
API validator
Tool for validating API implementations against their own documentation
Browser automator
A high-level browser automation library that allows users to interact with web pages in a synchronous manner.
clips/pattern8.8K
Web miner
A comprehensive Python module for web mining and analysis of text data.
Post-exploitation tool framework
An open-source framework for creating custom post-exploitation tools with automated payload generation and platform independence.
spatie/crawler2.6K
Crawler
A powerful web crawler written in PHP that can execute JavaScript and crawl multiple URLs concurrently.
Web testing tool
A Python test framework for automating web applications using Selenium and other tools.
manisso/fsociety10.7K
Hacking toolkit
A comprehensive collection of hacking tools and scripts for penetration testing and vulnerability assessment
App framework
A composite application library for Backbone.js that simplifies the construction of large-scale JavaScript applications
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions grab.
