scrapydweb

Scrapy cluster manager

A web application for managing Scrapyd clusters, analyzing Scrapy logs, and visualizing results.

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO point_right

GitHub

3k stars
73 watching
566 forks
Language: Python
last commit: about 2 months ago
Linked from 1 awesome list

dashboardlog-analysislog-parsingscrapyscrapy-log-analysisscrapy-visualizationscrapydscrapyd-adminscrapyd-apiscrapyd-cluster-managementscrapyd-controlscrapyd-keeperscrapyd-log-analysisscrapyd-managescrapyd-monitorscrapyd-uiscrapyd-visualizationspider

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
rowyio/rowy A web-based platform for managing data in Firestore using a spreadsheet-like interface and automating workflows with cloud functions. 6,233
gocolly/colly A framework for extracting structured data from websites in a fast and elegant way 23,444
thirtydegreesray/openhub An Android client app providing features and functionality similar to GitHub's official mobile apps, covering repository browsing, issue management, user profiles, and collaboration tools. 4,244
yanfengliu/turkey Enables crowd-sourced image annotation using Amazon Mechanical Turk 66
luckyframework/lucky A Crystal-based web framework designed to catch bugs and optimize performance for rapid development 2,607
mechanicalsoup/mechanicalsoup Automates interaction with websites by simulating browser behavior and handling HTTP sessions and document navigation. 4,685
mljar/mercury Converts Jupyter Notebooks to interactive web applications with customizable widgets and re-execution of cells on change. 4,071
konloch/bytecode-viewer A Java-based tool for analyzing and modifying Android APKs and other Java files 14,733
ruipgil/scraperjs A versatile web scraping module with two scrapers for static and dynamic content extraction. 3,714
unclecode/crawl4ai A web crawling tool designed to extract structured data from the web for use in AI applications 18,541
gradio-app/gradio Enables rapid creation and deployment of web applications for machine learning models and functions using Python 34,557
tautulli/tautulli A Python-based monitoring and tracking tool for Plex Media Server. 5,688
holoviz/panel A powerful data exploration and web app framework that lets you build complex applications entirely in Python using popular visualization tools 4,858
pbylicki/rfhub2 A web application built with FastAPI and Material-UI for collecting, browsing, and sharing documentation of existing keywords in RobotFramework and Python. 30
halcy/mastodon.py A Python wrapper for the Mastodon API allowing developers to interact with the social media platform's public and private APIs. 889