scrapydweb

Scrapy cluster manager

A web application for managing Scrapyd clusters, analyzing Scrapy logs, and visualizing results.

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO point_right

GitHub

3k stars
73 watching
566 forks
Language: Python
last commit: almost 2 years ago
Linked from 1 awesome list

dashboardlog-analysislog-parsingscrapyscrapy-log-analysisscrapy-visualizationscrapydscrapyd-adminscrapyd-apiscrapyd-cluster-managementscrapyd-controlscrapyd-keeperscrapyd-log-analysisscrapyd-managescrapyd-monitorscrapyd-uiscrapyd-visualizationspider

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
rowyio/rowyA web-based platform for managing data in Firestore using a spreadsheet-like interface and automating workflows with cloud functions.6,233
gocolly/collyA framework for extracting structured data from websites in a fast and elegant way23,444
thirtydegreesray/openhubAn Android client app providing features and functionality similar to GitHub's official mobile apps, covering repository browsing, issue management, user profiles, and collaboration tools.4,244
yanfengliu/turkeyEnables crowd-sourced image annotation using Amazon Mechanical Turk66
luckyframework/luckyA Crystal-based web framework designed to catch bugs and optimize performance for rapid development2,607
mechanicalsoup/mechanicalsoupAutomates interaction with websites by simulating browser behavior and handling HTTP sessions and document navigation.4,685
mljar/mercuryConverts Jupyter Notebooks to interactive web applications with customizable widgets and re-execution of cells on change.4,071
konloch/bytecode-viewerA Java-based tool for analyzing and modifying Android APKs and other Java files14,733
ruipgil/scraperjsA versatile web scraping module with two scrapers for static and dynamic content extraction.3,714
unclecode/crawl4aiA web crawling tool designed to extract structured data from the web for use in AI applications18,541
gradio-app/gradioEnables rapid creation and deployment of web applications for machine learning models and functions using Python34,557
tautulli/tautulliA Python-based monitoring and tracking tool for Plex Media Server.5,688
holoviz/panelA powerful data exploration and web app framework that lets you build complex applications entirely in Python using popular visualization tools4,858
pbylicki/rfhub2A web application built with FastAPI and Material-UI for collecting, browsing, and sharing documentation of existing keywords in RobotFramework and Python.30
halcy/mastodon.pyA Python wrapper for the Mastodon API allowing developers to interact with the social media platform's public and private APIs.889