portia
Web scraper
A visual scraping tool that extracts data from websites without requiring programming knowledge.
Visual scraping for Scrapy
9k stars
500 watching
1k forks
Language: Python
last commit: 8 months ago
Linked from 2 awesome lists
jobbole/awesome-python-cn
brucedone/awesome-crawlerRelated projects:
| Repository | Description | Stars |
|---|---|---|
 scrapy/scrapy | A fast high-level framework for extracting structured data from websites | 53,484 |
 ionicabizau/scrape-it | A Node.js library and CLI tool for automating web page scraping and parsing | 4,024 |
 propublica/upton | A web scraping framework that simplifies the process by handling repetitive tasks and provides options for efficient data retrieval | 1,612 |
 ruipgil/scraperjs | A versatile web scraping module with two scrapers for static and dynamic content extraction. | 3,714 |
 spatie/crawler | A powerful web crawler written in PHP that can execute JavaScript and crawl multiple URLs concurrently. | 2,552 |
 howie6879/ruia | An async web scraping micro-framework built with asyncio and aiohttp to simplify URL crawling | 1,753 |
 vinitshahdeo/portscanner | A tool for scanning network ports to identify open connections | 133 |
 spekulatius/phpscraper | A web scraping utility for PHP that simplifies the process of extracting information from websites. | 544 |
 azubieta/appimages.scraper | A tool to extract AppImage release data from web pages | 11 |
 holgerd77/django-dynamic-scraper | An app that allows you to manage Scrapy spiders through a Django admin interface. | 1,155 |
 benibela/xidel | A tool to extract data from web pages using various query languages and selectors. | 690 |
 telstrapurple/purpleexplorer | An Azure Service Bus explorer tool for desktop applications | 165 |
 my8100/scrapydweb | A web application for managing Scrapyd clusters, analyzing Scrapy logs, and visualizing results. | 3,180 |
 portainer/portainer | A single container application for managing Docker and Kubernetes environments through a GUI and/or extensive API | 31,343 |
 apify/crawlee | A tool for building reliable web scraping and browser automation pipelines in Node.js. | 16,081 |