awesome-kafka

Kafka toolkit

A curated collection of useful libraries and tools for working with Apache Kafka

A curated list of awesome things related to Apache Kafka

GitHub

247 stars
19 watching
43 forks
last commit: almost 2 years ago
Linked from 1 awesome list

awesomeawesome-listkafka

Awesome Kafka / Libraries / Kafka

topicctl603almost 2 years agoA tool for easy, declarative management of Kafka topics. Includes the ability to "apply" topic changes from YAML as well as a repl for interactive exploration of brokers, topics, consumer groups, messages, and more
sarama11,629almost 2 years agoSarama is an MIT-licensed Go client library for Apache Kafka version 0.8 (and later)
kadeckApache Kafka Monitoring, Kafka UI and data platform for Desktop or Web
conduktor
mirus204almost 2 years agoMirus is a cross data-center data replication tool for Apache Kafka
kareldb393almost 2 years agoA Relational Database Backed by Apache Kafka
kcache245almost 2 years agoAn In-Memory Cache Backed by Apache Kafka
kafka-lag-based-assignor12almost 6 years agoKafka partition assignor that distributes lag evenly across a consumer group
kafka-pixy773over 2 years agoKafka-Pixy is a dual API (gRPC and REST) proxy for Kafka with automatic consumer group control
Burrow3,776almost 2 years agoKafka Consumer Lag Checking
kafka-tools595over 4 years agoA collection of tools for working with Apache Kafka
schema-registry-ui421over 2 years agoWeb tool for Avro Schema Registry
kafkacat5,468about 2 years agoGeneric command line non-JVM Apache Kafka producer and consumer
kafka-jackson7over 8 years agoKafka Serializer, Deserializer, and Serde for Jackson JSON
kafkahq3,432almost 2 years agoKafka GUI for topics, topics data, consumers group, schema registry, connect and more
secor1,846almost 2 years agoSecor is a service implementing Kafka log persistence
reactive-kafka1,417over 1 year agoAlpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka
kafka-monitor2,023almost 3 years ago
chaperone641over 5 years agoA Kafka audit system
uReplicator918almost 3 years agoImprovement of Apache Kafka Mirrormaker
kafka-websocket347almost 3 years ago
kafka-unit174almost 5 years ago
cruise-control2,777almost 2 years agoCruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a kafka cluster
jocko4,939almost 3 years agoKafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)
hermes820almost 2 years agoFast and reliable message broker built on top of Kafka
kt947over 2 years agoKafka command line tool
kafka-eagle3,090about 2 years agoUsed to monitor the consumer status of Kafka clusters, as well as offsets, metadata and other information
dockerkafka633almost 5 years agoDoctorKafka is a service for Kafka cluster auto healing and workload balancing
kasper439about 9 years agoKasper is a lightweight library for processing Kafka topics
Yelp kafka-utils314about 3 years ago
kafka-spark-consumer635over 4 years ago
kafka-streams-cep308almost 3 years agoComplex Event Processing on top of Kafka Streams
spring-kafka2,244almost 2 years ago
ksql-machine-learning-udf11over 8 years ago
kafkabeat6about 9 years agoElasticsearch Beats for kafka
sangrenel204over 3 years ago
Strimzi4,904almost 2 years agoOperator for deploying and running Apache Kafka on Kubernetes and OpenShift
Kafka Manager11,853about 3 years agoWeb-based tool for managing a Kafka cluster
Strimzi Kafka CLI82almost 2 years agoA CLI for Strimzi Kafka Operator
Kafka Cluster Kraft Mode - DockerCompose18about 2 years agoWorkable kafka cluster with kraft mode using docker-compose
Decaton337about 2 years agoHigh throughput asynchronous task processing framework

Awesome Kafka / Libraries / Kafka UI

KafkaTrail6over 2 years ago
kafka-topics-ui876over 4 years ago
kafka-connect-ui508almost 3 years agoWeb tool for Kafka Connect
Kafdrop5,620almost 2 years agoWeb UI for browsing Kafka topics and consumer groups
kafka-webview394almost 2 years ago
kafka-view219about 4 years ago
cruise-control-ui350about 2 years ago
real-time-ui-with-kafka-streams31almost 9 years ago
tsujun53about 8 years agoYet another Web UI for KSQL
kowl3,860almost 2 years ago
akhq

Awesome Kafka / Libraries / Kafka Streams

schema-registry-ui421over 2 years ago
kafka-streams-consumer-offsets-to-json13almost 7 years agoA Kafka Streams process to convert consumer_offsets to a JSON-readable topic
kafka-operator295almost 8 years ago
kafkabalancer48almost 9 years ago
mockedstreams187over 5 years ago
winton-kafka-streams311over 7 years agoA Python implementation of Apache Kafka Streams

Awesome Kafka / Libraries / Kafka Connect

Apache Camel Kafka Connect340+ Apache Camel components as Kafka Connect connectors
kafka-connect-client40almost 2 years agoA kafka-connect REST api client for java
Confluent Connector Hub
kafka-connect-protobuf-converter94about 3 years agoProtobuf converter plugin for Kafka Connect
Maxwell4,059almost 2 years ago
kafka-connect-transformers8almost 8 years ago
kafka-connect-mq-source95almost 2 years ago
kafka-connect-jenkins30almost 4 years ago
toketi-kafka-connect-iohub40over 6 years ago
connectctl12over 4 years agoManage kafka connect connectors easily
kafka-connect-transform-common156about 2 years agoCommon Transforms for Kafka Connect
aiven-kafka-connect-transforms75almost 2 years agoA collection of Single Message Transformations (SMTs) for Kafka Connect
kafka-connect-file-pulse324almost 2 years agoA polyvalent, scalable and reliable, Kafka Connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
kafka-connect-http30about 4 years ago
snowflake-kafka-connector141over 1 year ago

Awesome Kafka / Libraries / REST Proxy

kafka-rest54almost 2 years agoConfluent REST Proxy
strimzi-http-bridge293over 1 year agoStrimzi Kafka Bridge (AMQP & HTTP)
Zilla553almost 2 years agoAn API gateway built for event-driven architectures and streaming that supports standard protocols such as HTTP, SSE, gRPC, MQTT and the native Kafka protocol

Awesome Kafka / Libraries / Schema Registry

apicurio-registry606almost 2 years agoApicurio API/schema registry (includes UI)
schema-registry2,233almost 2 years agoConfluent Schema registry for Kafka
ksql-jdbc-driver87over 4 years ago

Awesome Kafka / Libraries / Other Awesome Kafka

ApacheKafka35almost 3 years ago
dharmeshkakadia/awesome-kafka206about 3 years ago
infoslack/awesome-kafka578over 2 years ago
awesome-kafka-playground1over 8 years ago

Awesome Kafka / Libraries / Kafkaesque

Pulsar14,315almost 2 years ago
Flink
Spark
Heron3,638over 3 years ago
Beam
Arrow
Samza
Nats
Chronicle-Queue3,350almost 2 years ago
CorfuDB642almost 2 years ago
GenStage
faust6,751about 2 years agoPython Stream Processing
redpanda
Meteor23about 4 years agoLightweight, broker-less alternative to Kafka for message streaming

Awesome Kafka / Resources / Learning

Passionate Developer: Kafka Streams DSL vs processor API
Mastering Kafka Streams
Spark Streaming + Kafka Integration Guide

Awesome Kafka / Resources / Blogs

CodingJunkieRandom Thoughts on Coding by Bill Bejeck
Understanding Kafka with Factorio

Awesome Kafka / Resources / Books

Kafka Streams in Action
Kafka in Action
Kafka the Definitive Guide
Streaming Data Pipelines with Kafka

Backlinks from these awesome lists:

More related projects: