databus

Data pipeline system

A distributed system to capture changes from primary data stores and route them through complex data pipelines.

Source-agnostic distributed change data capture system

GitHub

4k stars
381 watching
736 forks
Language: Java
last commit: almost 3 years ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
datahub-project/datahubA platform for managing and discovering data across an organization's data stack10,046
debezium/debeziumA platform that captures and streams data changes from relational databases into Kafka topics10,836
linkedin/brooklinA distributed system for streaming data between heterogeneous systems with high reliability and throughput at scale931
linkedin/ambryA distributed object store designed to efficiently store and serve large media objects in web applications.1,749
mit-pdos/noriaA streaming data-flow system designed to act as a fast storage backend for read-heavy web applications by caching relational query results.5,008
databendlabs/databendA high-performance, scalable data warehouse built on Rust, offering blazing-fast query execution and real-time analytics capabilities.7,978
ha/doozerdA distributed data store with real-time updates and high availability features.3,269
netdata/netdataA high-performance observability platform designed to simplify modern infrastructure monitoring and provide real-time insights into systems and applications.72,607
linkedin/cruise-controlAutomates dynamic workload rebalance and self-healing of large-scale Apache Kafka clusters2,777
voldemort/voldemortA distributed key-value storage system with data replication, partitioning, and versioning.2,642
lindb/lindbA high-performance, distributed time series database with horizontal scalability and high availability3,010
cube-js/cubeA platform for building data applications with efficient data modeling, access control, and performance optimizations.18,068
arch/autohistoryAutomatically records and tracks changes to data in databases using Microsoft.EntityFrameworkCore785
pudo/datasetA Python library simplifying data handling in SQL databases with features like implicit table creation and bulk loading.4,785
linkedinattic/datafuA collection of libraries for working with large-scale data in Hadoop, providing incremental processing capabilities and user-defined functions.583