awesome-kafka
A curated list of awesome things related to Apache Kafka
230 stars
19 watching
41 forks
last commit: 4 months ago
Linked from 1 awesome list
awesomeawesome-listkafka
Awesome Kafka / Libraries / Kafka | |||
| topicctl | 589 | 3 months ago | A tool for easy, declarative management of Kafka topics. Includes the ability to "apply" topic changes from YAML as well as a repl for interactive exploration of brokers, topics, consumer groups, messages, and more |
| sarama | 11,440 | 4 days ago | Sarama is an MIT-licensed Go client library for Apache Kafka version 0.8 (and later) |
| kadeck | Apache Kafka Monitoring, Kafka UI and data platform for Desktop or Web | ||
| conduktor | |||
| mirus | 201 | 2 months ago | Mirus is a cross data-center data replication tool for Apache Kafka |
| kareldb | 393 | 8 days ago | A Relational Database Backed by Apache Kafka |
| kcache | 245 | 4 days ago | An In-Memory Cache Backed by Apache Kafka |
| kafka-lag-based-assignor | 12 | almost 4 years ago | Kafka partition assignor that distributes lag evenly across a consumer group |
| kafka-pixy | 768 | 6 months ago | Kafka-Pixy is a dual API (gRPC and REST) proxy for Kafka with automatic consumer group control |
| Burrow | 3,733 | 2 months ago | Kafka Consumer Lag Checking |
| kafka-tools | 592 | over 2 years ago | A collection of tools for working with Apache Kafka |
| schema-registry-ui | 421 | 8 months ago | Web tool for Avro Schema Registry |
| kafkacat | 5,402 | 3 months ago | Generic command line non-JVM Apache Kafka producer and consumer |
| kafka-jackson | 6 | over 6 years ago | Kafka Serializer, Deserializer, and Serde for Jackson JSON |
| kafkahq | 3,370 | 4 days ago | Kafka GUI for topics, topics data, consumers group, schema registry, connect and more |
| secor | 1,845 | 8 days ago | Secor is a service implementing Kafka log persistence |
| reactive-kafka | 1,417 | 5 days ago | Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka |
| kafka-monitor | 2,020 | 12 months ago | |
| chaperone | 640 | over 3 years ago | A Kafka audit system |
| uReplicator | 913 | 10 months ago | Improvement of Apache Kafka Mirrormaker |
| kafka-websocket | 345 | 10 months ago | |
| kafka-unit | 174 | almost 3 years ago | |
| cruise-control | 2,740 | 4 days ago | Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a kafka cluster |
| jocko | 4,923 | 11 months ago | Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native) |
| hermes | 811 | 8 days ago | Fast and reliable message broker built on top of Kafka |
| kt | 950 | 6 months ago | Kafka command line tool |
| kafka-eagle | 3,066 | about 2 months ago | Used to monitor the consumer status of Kafka clusters, as well as offsets, metadata and other information |
| dockerkafka | 633 | almost 3 years ago | DoctorKafka is a service for Kafka cluster auto healing and workload balancing |
| kasper | 439 | about 7 years ago | Kasper is a lightweight library for processing Kafka topics |
| Yelp kafka-utils | 314 | about 1 year ago | |
| kafka-spark-consumer | 632 | over 2 years ago | |
| kafka-streams-cep | 308 | 10 months ago | Complex Event Processing on top of Kafka Streams |
| spring-kafka | 2,167 | 4 days ago | |
| ksql-machine-learning-udf | 12 | over 6 years ago | |
| kafkabeat | 6 | about 7 years ago | Elasticsearch Beats for kafka |
| sangrenel | 206 | over 1 year ago | |
| Strimzi | 4,775 | 11 days ago | Operator for deploying and running Apache Kafka on Kubernetes and OpenShift |
| Kafka Manager | 11,808 | about 1 year ago | Web-based tool for managing a Kafka cluster |
| Strimzi Kafka CLI | 79 | about 1 month ago | A CLI for Strimzi Kafka Operator |
| Kafka Cluster Kraft Mode - DockerCompose | 17 | 2 months ago | Workable kafka cluster with kraft mode using docker-compose |
| Decaton | 329 | about 1 month ago | High throughput asynchronous task processing framework |
Awesome Kafka / Libraries / Kafka UI | |||
| KafkaTrail | 2 | 4 months ago | |
| kafka-topics-ui | 877 | over 2 years ago | |
| kafka-connect-ui | 503 | 10 months ago | Web tool for Kafka Connect |
| Kafdrop | 5,484 | 4 days ago | Web UI for browsing Kafka topics and consumer groups |
| kafka-webview | 395 | 16 days ago | |
| kafka-view | 218 | about 2 years ago | |
| cruise-control-ui | 342 | about 2 months ago | |
| real-time-ui-with-kafka-streams | 31 | about 7 years ago | |
| tsujun | 53 | about 6 years ago | Yet another Web UI for KSQL |
| kowl | 3,768 | 3 days ago | |
| akhq | |||
Awesome Kafka / Libraries / Kafka Streams | |||
| schema-registry-ui | 421 | 8 months ago | |
| kafka-streams-consumer-offsets-to-json | 13 | almost 5 years ago | A Kafka Streams process to convert consumer_offsets to a JSON-readable topic |
| kafka-operator | 297 | almost 6 years ago | |
| kafkabalancer | 48 | almost 7 years ago | |
| mockedstreams | 186 | over 3 years ago | |
| winton-kafka-streams | 313 | over 5 years ago | A Python implementation of Apache Kafka Streams |
Awesome Kafka / Libraries / Kafka Connect | |||
| Apache Camel Kafka Connect | 340+ Apache Camel components as Kafka Connect connectors | ||
| kafka-connect-client | 35 | 2 months ago | A kafka-connect REST api client for java |
| Confluent Connector Hub | |||
| kafka-connect-protobuf-converter | 94 | over 1 year ago | Protobuf converter plugin for Kafka Connect |
| Maxwell | 4,012 | 4 days ago | |
| kafka-connect-transformers | 8 | almost 6 years ago | |
| kafka-connect-mq-source | 93 | 8 days ago | |
| kafka-connect-jenkins | 30 | almost 2 years ago | |
| toketi-kafka-connect-iohub | 40 | over 4 years ago | |
| connectctl | 12 | over 2 years ago | Manage kafka connect connectors easily |
| kafka-connect-transform-common | 151 | 2 months ago | Common Transforms for Kafka Connect |
| aiven-kafka-connect-transforms | 72 | 4 days ago | A collection of Single Message Transformations (SMTs) for Kafka Connect |
| kafka-connect-file-pulse | 322 | 8 days ago | A polyvalent, scalable and reliable, Kafka Connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka |
| kafka-connect-http | 30 | about 2 years ago | |
| snowflake-kafka-connector | 138 | 3 days ago | |
Awesome Kafka / Libraries / REST Proxy | |||
| kafka-rest | 38 | 3 days ago | Confluent REST Proxy |
| strimzi-http-bridge | 280 | 7 days ago | Strimzi Kafka Bridge (AMQP & HTTP) |
| Zilla | 531 | 5 days ago | An API gateway built for event-driven architectures and streaming that supports standard protocols such as HTTP, SSE, gRPC, MQTT and the native Kafka protocol |
Awesome Kafka / Libraries / Schema Registry | |||
| apicurio-registry | 588 | 3 days ago | Apicurio API/schema registry (includes UI) |
| schema-registry | 2,207 | 3 days ago | Confluent Schema registry for Kafka |
| ksql-jdbc-driver | 88 | over 2 years ago | |
Awesome Kafka / Libraries / Other Awesome Kafka | |||
| ApacheKafka | 33 | 10 months ago | |
| dharmeshkakadia/awesome-kafka | 202 | about 1 year ago | |
| infoslack/awesome-kafka | 578 | 8 months ago | |
| awesome-kafka-playground | 1 | over 6 years ago | |
Awesome Kafka / Libraries / Kafkaesque | |||
| Pulsar | 14,141 | 12 days ago | |
| Flink | |||
| Spark | |||
| Heron | 3,645 | over 1 year ago | |
| Beam | |||
| Arrow | |||
| Samza | |||
| Nats | |||
| Chronicle-Queue | 3,267 | 8 days ago | |
| CorfuDB | 639 | 12 days ago | |
| GenStage | |||
| faust | 6,726 | 2 months ago | Python Stream Processing |
| redpanda | |||
| Meteor | 23 | about 2 years ago | Lightweight, broker-less alternative to Kafka for message streaming |
Awesome Kafka / Resources / Learning | |||
| Passionate Developer: Kafka Streams DSL vs processor API | |||
| Mastering Kafka Streams | |||
| Spark Streaming + Kafka Integration Guide | |||
Awesome Kafka / Resources / Blogs | |||
| CodingJunkie | Random Thoughts on Coding by Bill Bejeck | ||
| Understanding Kafka with Factorio | |||
Awesome Kafka / Resources / Books | |||
| Kafka Streams in Action | |||
| Kafka in Action | |||
| Kafka the Definitive Guide | |||
| Streaming Data Pipelines with Kafka | |||
monksy/awesome-kafka