arroyo
Stream processor
A distributed stream processing engine designed to efficiently perform stateful computations on high-volume real-time data streams.
Distributed stream processing engine in Rust
4k stars
40 watching
226 forks
Language: Rust
last commit: 2 months ago
Linked from 1 awesome list
datadata-stream-processingdev-toolsinfrastructurekafkarustsqlstream-processingstream-processing-engine
rust-unofficial/awesome-rustRelated projects:
| Repository | Description | Stars |
|---|---|---|
 apache/flink | An open-source stream processing framework with powerful capabilities for handling high-throughput and low-latency data streams in various programming languages | 24,261 |
 infinyon/fluvio | A distributed data streaming and stream processing system | 3,932 |
 timeplus-io/proton | A fast and lightweight stream processing engine and database that integrates ClickHouse capabilities with real-time data transformation and analysis. | 1,605 |
 risingwavelabs/risingwave | A Postgres-compatible, unified stream processing and analytics database for real-time event data | 7,141 |
 olacabs/fabric | A real-time stream processing framework designed to handle high-volume event ingestion and complex data processing tasks with guaranteed availability and scalability. | 55 |
 swimos/swim-rust | A software platform for building real-time streaming applications with stateful agents and multiplexed APIs. | 321 |
| apache/datafusion | A query engine that supports various data formats and allows customization of its functionality. | 6,462 |
 gazette/core | Enables teams to build platforms mixing SQL, batch, and real-time streaming processing paradigms | 723 |
 faust-streaming/faust | A Python stream processing library that enables real-time data pipelines and event-driven systems with scalability and reliability. | 1,675 |
 mit-pdos/noria | A streaming data-flow system designed to act as a fast storage backend for read-heavy web applications by caching relational query results. | 5,008 |
 robinhood/faust | Builds high-performance distributed systems and real-time data pipelines using asynchronous event processing and in-memory durable key-value stores. | 6,751 |
| apache/beam | A unified programming model for batch and streaming data processing pipelines | 7,911 |
 quixio/quix-streams | A Python framework for real-time data processing on Apache Kafka streams | 1,246 |
 yahoo/streaming-benchmarks | A comprehensive benchmarking platform for evaluating low-latency stream processing solutions | 635 |
 nanosai/stream-ops-java | A Java-based data streaming engine and stream processing API designed to be embeddable in various applications. | 48 |