faust

Data pipeline builder

Builds high-performance distributed systems and real-time data pipelines using asynchronous event processing and in-memory durable key-value stores.

Python Stream Processing

GitHub

7k stars
139 watching
534 forks
Language: Python
last commit: 6 months ago
Linked from 9 awesome lists

asynciodistributed-systemskafkakafka-streamspythonstream-processing

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
tschellenbach/stream-framework A Python library for building activity streams and newsfeeds using distributed data stores 4,733
pathwaycom/pathway A Python-based ETL framework for stream processing and real-time analytics with a scalable Rust engine. 7,174
microsoft/playwright-python A Python library to automate Chromium, Firefox and WebKit browsers with a single API 12,045
pytransitions/transitions An object-oriented finite state machine implementation in Python with many extensions. 5,822
arroyosystems/arroyo A distributed stream processing engine designed to efficiently perform stateful computations on high-volume real-time data streams. 3,840
mongodb/motor A Python driver for MongoDB with non-blocking access and support for asyncio and Tornado applications 2,446
mechanicalsoup/mechanicalsoup Automates interaction with websites by simulating browser behavior and handling HTTP sessions and document navigation. 4,685
astral-sh/ruff A fast and powerful Python code linter and formatter written in Rust. 33,816
infinyon/fluvio A distributed data streaming and stream processing system 3,932
deezer/spleeter A Python library for separating audio sources in real-time with high accuracy and speed. 26,041
redpanda-data/connect Stream processor for connecting various data sources and sinks using Apache V2 or Enterprise builds. 8,165
skelsec/pypykatz An implementation of Mimikatz in pure Python for parsing Windows secrets and registry data. 2,905
cloudtools/troposphere A Python library to generate AWS CloudFormation descriptions in JSON or YAML format 4,933
finos/perspective A component for creating interactive analytics and data visualization applications with support for large datasets and streaming queries. 8,669
windmill-labs/windmill An open-source developer platform that integrates scripts with UIs and workflows, allowing for automation of infrastructure and business processes. 11,216