broadway

Data processor

A concurrent and multi-stage data ingestion and processing framework in Elixir

Concurrent and multi-stage data ingestion and data processing with Elixir

GitHub

2k stars
47 watching
161 forks
Language: Elixir
last commit: almost 2 years ago
Linked from 1 awesome list

broadwayconcurrentdata-ingestiondata-processingelixirgenstage

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
multiprocessio/datastationAn all-in-one application for querying, scripting, and visualizing data from various sources2,907
elixir-ecto/ectoA toolkit for mapping data and querying databases in Elixir.6,212
dashbitco/flowA parallel computation library on top of GenStage for Elixir1,560
bitwalker/distilleryGenerates an Erlang/OTP release from a Mix project, allowing for independent deployment without Elixir installation.2,965
ovh/cdsAn enterprise-grade platform for automating continuous delivery and devops workflows using Go.4,620
whatyouhide/xandraA Cassandra/ScyllaDB driver for Elixir that provides fast and robust connection pooling, query preparation, and streaming capabilities.406
pachyderm/pachydermAutomates data transformations with versioning and lineage tracking for scalable data pipelines6,191
zookzook/elixir-mongodb-driverA MongoDB driver for Elixir providing a connection to a MongoDB database and support for various query operations and features.249
nebo15/rbmqProvides an easy-to-use API for spawning RabbitMQ producers and consumers.21
hazelcast/hazelcastProvides a unified real-time data platform combining stream processing with a fast data store for instant insights and action on data-in-motion.6,183
crowdhailer/okProvides elegant error handling and result monad support in Elixir603
exstruct/etudeA concurrency utility library for Elixir/ERlang that simplifies the use of async and retry mechanisms in concurrent programming.11
beekeeper-studio/beekeeper-studioA cross-platform SQL client and database manager with support for multiple databases and platforms.16,974
airbytehq/airbyteA platform for building data integration pipelines between various data sources and destinations16,441