streamparse
Stream processor
Enables real-time computation on live streams of data using Python
Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
1k stars
101 watching
218 forks
Language: Python
last commit: 3 months ago
Linked from 3 awesome lists
apache-stormpythonstorm
vinta/awesome-python
jobbole/awesome-python-cn
manuzhang/awesome-streamingRelated projects:
| Repository | Description | Stars |
|---|---|---|
 python-streamz/streamz | A library for building and managing real-time stream processing pipelines in Python | 1,244 |
 csiro-hydroinformatics/pybomwater | A Python tool for accessing data from the Bureau of Meteorology's Water Data Service using SOS2 protocol | 21 |
 bytewax/bytewax | A Python framework for stateful stream and event processing with built-in connectors and flexible dataflow capabilities. | 1,558 |
 scramjetorg/framework-python | Reactive stream processing framework for Python | 35 |
 quixio/quix-streams | A Python framework for real-time data processing on Apache Kafka streams | 1,190 |
 spencerahill/aospy | Automates computations involving gridded climate data and manages results | 84 |
 akrherz/iem | Provides a comprehensive system for ingesting and processing weather data from multiple sources, generating products, and maintaining a web presence. | 142 |
 apache/pulsar-client-python | A Python client library for connecting to and interacting with a distributed message broker | 53 |
 substantic/rain | A framework for processing large-scale task-based pipelines in a distributed manner | 748 |
| akrherz/pyiem | Python tools and parsers for weather data processing and ingest. | 43 |
 airsage/petrel | Tools and framework for building, deploying, and managing Storm topologies using pure Python. | 247 |
 mdbartos/pysheds | A Python library for watershed delineation from digital elevation models. | 722 |
 pyswmm/pyswmm | Provides a Python interface to the US Environmental Protection Agency's Stormwater Management Model (SWMM) for hydraulic modeling and hydrology analysis. | 292 |
 svenkreiss/pysparkling | A lightweight Python implementation of Spark's RDD and DStream interfaces for improved performance on small datasets | 262 |
 maki-nage/makinage | Stream Processing Library and Framework | 39 |