bottledwater-pg
CDC tool
A project that extracts change data capture from PostgreSQL into Kafka using logical decoding and Avro encoding.
Change data capture from PostgreSQL into Kafka
3 stars
168 watching
149 forks
Language: C
last commit: over 1 year ago
Linked from 2 awesome lists
igorbarinov/awesome-data-engineering
monksy/awesome-data-engineeringRelated projects:
| Repository | Description | Stars |
|---|---|---|
| confluentinc/confluent-kafka-python | A Python client for Apache Kafka that provides reliable and performant messaging capabilities | 127 |
| confluentinc/ksql | A database for real-time stream processing applications built on top of Apache Kafka. | 125 |
| confluentinc/librdkafka | A high-performance client library for the Apache Kafka messaging system | 284 |
| confluentinc/ducktape | Tools and utilities for testing distributed systems, providing features like isolation, service management, and event triggering. | 16 |
| confluentinc/kafka-rest | Provides a RESTful interface to interact with a Kafka cluster without using the native protocol or clients | 46 |
| confluentinc/confluent-kafka-dotnet | A .NET client library for interacting with Apache Kafka clusters | 87 |
| confluentinc/schema-registry | Provides a central repository for storing and managing data schema definitions in various formats. | 2,225 |
| confluentinc/kafka-connect-jdbc | A Kafka connector that enables data exchange between Kafka and JDBC-compatible databases. | 21 |
| confluentinc/kafka-connect-hdfs | A Kafka connector that enables data transfer between Kafka and Hadoop's Distributed File System | 12 |
 dimitri/pgcopydb | Automates copying of databases between Postgres servers with parallel processing and streaming capabilities. | 1,192 |
 turbolytics/sql-flow | An open-source tool that enables writing Kafka stream processing logic using standard SQL syntax. | 69 |
 cenc-cea/tsarchive | Automates archiving of data packets from Kafka topic into TDEngine time series database | 3 |
 fgeller/kt | A command-line tool for interacting with Apache Kafka clusters | 948 |
 cgutteridge/ntcat | A command line tool for combining and manipulating RDF data files in NTriples format | 0 |
 cpursley/walex | A Postgres CDC library that captures changes to tables and allows callback-like actions on data in Elixir. | 287 |