portia
Web scraper
A visual scraping tool that extracts data from websites without requiring programming knowledge.
Visual scraping for Scrapy
9k stars
502 watching
1k forks
Language: Python
last commit: 5 months ago
Linked from 2 awesome lists
jobbole/awesome-python-cn
brucedone/awesome-crawlerRelated projects:
| Repository | Description | Stars |
|---|---|---|
 scrapy/scrapy | A fast high-level framework for extracting structured data from websites | 53,156 |
 ionicabizau/scrape-it | A Node.js library and CLI tool for automating web page scraping and parsing | 4,012 |
 propublica/upton | A web scraping framework that simplifies the process by handling repetitive tasks and provides options for efficient data retrieval | 1,613 |
 ruipgil/scraperjs | A versatile web scraping module with two scrapers for static and dynamic content extraction. | 3,710 |
 spatie/crawler | A powerful web crawler written in PHP that can execute JavaScript and crawl multiple URLs concurrently. | 2,537 |
 howie6879/ruia | An async web scraping micro-framework built with asyncio and aiohttp to simplify URL crawling | 1,752 |
 vinitshahdeo/portscanner | A tool for scanning network ports to identify open connections | 133 |
 spekulatius/phpscraper | A web scraping utility for PHP that simplifies the process of extracting information from websites. | 536 |
 azubieta/appimages.scraper | A tool to extract AppImage release data from web pages | 11 |
 holgerd77/django-dynamic-scraper | An app that allows you to manage Scrapy spiders through a Django admin interface. | 1,153 |
 benibela/xidel | A tool to extract data from web pages using various query languages and selectors. | 681 |
 telstrapurple/purpleexplorer | An Azure Service Bus explorer tool for desktop applications | 165 |
 my8100/scrapydweb | A web application for managing Scrapyd clusters, analyzing Scrapy logs, and visualizing results. | 3,161 |
 portainer/portainer | A management platform for containerized applications and orchestrators | 31,065 |
 apify/crawlee | A tool for building reliable web scraping and browser automation pipelines in Node.js. | 15,604 |