broadway
Data processor
A concurrent and multi-stage data ingestion and processing framework in Elixir
Concurrent and multi-stage data ingestion and data processing with Elixir
2k stars
47 watching
161 forks
Language: Elixir
last commit: 12 days ago
Linked from 1 awesome list
broadwayconcurrentdata-ingestiondata-processingelixirgenstage
h4cc/awesome-elixirRelated projects:
| Repository | Description | Stars |
|---|---|---|
 multiprocessio/datastation | An all-in-one application for querying, scripting, and visualizing data from various sources | 2,903 |
 uber/cadence | An orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way. | 8,319 |
 elixir-ecto/ecto | A toolkit for mapping data and querying databases in Elixir. | 6,193 |
| dashbitco/flow | A parallel computation library on top of GenStage for Elixir | 1,553 |
 bitwalker/distillery | Generates an Erlang/OTP release from a Mix project, allowing for independent deployment without Elixir installation. | 2,967 |
 ovh/cds | An enterprise-grade platform for automating continuous delivery and devops workflows using Go. | 4,601 |
 whatyouhide/xandra | A Cassandra/ScyllaDB driver for Elixir that provides fast and robust connection pooling, query preparation, and streaming capabilities. | 405 |
 pachyderm/pachyderm | Automates data transformations with versioning and lineage tracking for scalable data pipelines | 6,179 |
 zookzook/elixir-mongodb-driver | A MongoDB driver for Elixir providing a connection to a MongoDB database and support for various query operations and features. | 245 |
 nebo15/rbmq | Provides an easy-to-use API for spawning RabbitMQ producers and consumers. | 21 |
 hazelcast/hazelcast | Provides a unified real-time data platform combining stream processing with a fast data store for instant insights and action on data-in-motion. | 6,152 |
 crowdhailer/ok | Provides elegant error handling and result monad support in Elixir | 602 |
 exstruct/etude | A concurrency utility library for Elixir/ERlang that simplifies the use of async and retry mechanisms in concurrent programming. | 11 |
 beekeeper-studio/beekeeper-studio | A cross-platform SQL client and database manager with support for multiple databases and platforms. | 16,751 |
 airbytehq/airbyte | A platform for building data integration pipelines between various data sources and destinations | 16,184 |