scrapydweb

Scrapy cluster manager

A web application for managing Scrapyd clusters, analyzing Scrapy logs, and visualizing results.

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO point_right

GitHub

3k stars
73 watching
565 forks
Language: Python
last commit: about 2 months ago
Linked from 1 awesome list

dashboardlog-analysislog-parsingscrapyscrapy-log-analysisscrapy-visualizationscrapydscrapyd-adminscrapyd-apiscrapyd-cluster-managementscrapyd-controlscrapyd-keeperscrapyd-log-analysisscrapyd-managescrapyd-monitorscrapyd-uiscrapyd-visualizationspider

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
rowyio/rowy A low-code platform for managing Firestore databases and building cloud functions workflows on the web. 6,193
gocolly/colly A framework for extracting structured data from websites in a fast and elegant way 23,351
thirtydegreesray/openhub An Android client app providing features and functionality similar to GitHub's official mobile apps, covering repository browsing, issue management, user profiles, and collaboration tools. 4,240
yanfengliu/turkey A web-based tool for annotating images with bounding boxes and polygons on Amazon Mechanical Turk. 66
luckyframework/lucky A Crystal-based web framework designed to catch bugs and optimize performance for rapid development 2,600
mechanicalsoup/mechanicalsoup Automates interaction with websites by simulating browser behavior and handling HTTP sessions and document navigation. 4,672
mljar/mercury Converts Jupyter Notebooks to interactive web applications with customizable widgets and re-execution of cells on change. 4,050
konloch/bytecode-viewer A Java-based tool for analyzing and modifying Android APKs and other Java files 14,710
ruipgil/scraperjs A versatile web scraping module with two scrapers for static and dynamic content extraction. 3,710
unclecode/crawl4ai A tool for web crawling and data extraction, designed to work with large language models. 16,180
gradio-app/gradio Enables rapid creation and deployment of web applications for machine learning models and functions using Python 34,108
tautulli/tautulli A Python-based monitoring and tracking tool for Plex Media Server. 5,639
holoviz/panel A powerful data exploration and web app framework that lets you build complex applications entirely in Python using popular visualization tools 4,802
pbylicki/rfhub2 A web application built with FastAPI and Material-UI for collecting, browsing, and sharing documentation of existing keywords in RobotFramework and Python. 30
halcy/mastodon.py A Python wrapper for the Mastodon API allowing developers to interact with the social media platform's public and private APIs. 884