arroyo
Stream processor
A distributed stream processing engine designed to efficiently perform stateful computations on high-volume real-time data streams.
Distributed stream processing engine in Rust
4k stars
41 watching
219 forks
Language: Rust
last commit: 7 days ago
Linked from 1 awesome list
datadata-stream-processingdev-toolsinfrastructurekafkarustsqlstream-processingstream-processing-engine
rust-unofficial/awesome-rustRelated projects:
| Repository | Description | Stars |
|---|---|---|
 apache/flink | An open-source stream processing framework with powerful capabilities for handling high-throughput and low-latency data streams in various programming languages | 24,107 |
 infinyon/fluvio | A lightweight distributed data streaming system written in Rust and Web Assembly for real-time data processing | 3,880 |
 timeplus-io/proton | A fast and lightweight streaming SQL engine that enables developers to process and analyze real-time data from various sources. | 1,570 |
 risingwavelabs/risingwave | A Postgres-compatible, unified stream processing and analytics database for real-time event data | 7,049 |
 olacabs/fabric | A real-time stream processing framework designed to handle high-volume event ingestion and complex data processing tasks with guaranteed availability and scalability. | 55 |
 swimos/swim-rust | A software platform for building real-time streaming applications with stateful agents and multiplexed APIs. | 314 |
| apache/datafusion | A query engine that supports various data formats and allows customization of its functionality. | 6,298 |
 gazette/core | Enables teams to build platforms mixing SQL, batch, and real-time streaming processing paradigms | 718 |
 faust-streaming/faust | A Python stream processing library that enables real-time data pipelines and event-driven systems with scalability and reliability. | 1,656 |
 mit-pdos/noria | A streaming data-flow system designed to act as a fast storage backend for read-heavy web applications by caching relational query results. | 5,000 |
 robinhood/faust | Builds high-performance distributed systems and real-time data pipelines using asynchronous event processing and in-memory durable key-value stores. | 6,746 |
| apache/beam | A unified programming model for batch and streaming data processing pipelines | 7,878 |
 quixio/quix-streams | A Python framework for real-time data processing on Apache Kafka streams | 1,190 |
 yahoo/streaming-benchmarks | A comprehensive benchmarking platform for evaluating low-latency stream processing solutions | 633 |
 nanosai/stream-ops-java | A Java-based data streaming engine and stream processing API designed to be embeddable in various applications. | 48 |