awesome-kafka
Everything about Apache Kafka
AI summary
Kafka toolkit
A comprehensive resource and collection of tools and libraries for Apache Kafka development
- stars
- 206
- forks
- 30
- watching
- 14
- awesome lists
- 2
- entries
- 150
What's in the list
150 links in 26 sections, with live GitHub stats.activeno commit in 2y
Development / Client libraries
- others
and
Go
Go
Go
Go Kafka streaming
Node
Node
Php
Php
Perl
Python (asyncio)
Python (kafka-python)
Python (pykafka)
Ruby
Phobos - Ruby App framework
Karafka - Ruby and Rails framework
Dart
JRuby
Elixir
Erlang
Rust
LinkedIn wrapper library
kasper - a lightweight library for processing Kafka topicsDevelopment / Kafka Streams Libraries
Scala
faust - Python Stream Processing
Southpaw - Streaming left joins for data change captureDevelopment / KSQL
KSQL JDBC Driver
KSQL Addon - User Defined Function (UDF) for Machine LearningDevelopment / Connectors
JDBC
Beast - Kafka to BigQuery Sink
Google Cloud Storage (GCS)
HBase
Streaming files from a local filesystem
kafka-connect-protobuf-converter
IBM MQ Source
Azure IoT Hub
Pulsar
HTTPDevelopment / Producers
Development / Consumers
Firehose
Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems
Raccoon is a high-throughput, low-latency service to collect events in real-time from your web, mobile apps, and services using multiple network protocols and publish to Kafka
Spark
DivolteDevelopment / Transformations
Dagger is an easy-to-use, SQL framework to process built on top of Apache Flink for stateful processing of Kafka data
Development / Testing
Mocked Streams - Topology testing library for Kafka Streams (no broker required)
Unit-testing for embedded kafka services
Kafka JUnit
Kafka Unit
Kafka for JUnit
Karate and Kafka
embedded-kafka - in-memory Kafka instance to run your tests againstOperations / CI/CD
kafka-gitopsOperations / Operational Utilities
DoctorKafka
and its successor
Brucke - Inter-cluster bridge of kafka topics
Kafka-Kit
kafkabalancer
Yelp Kafka-Utils
Cerner Common Kafka utilities
connectctl - manage kafka connect connectors easilyOperations / Monitoring
Kafka Offset Exporter
Fluent plugin
Remora
Kafka Offset Monitoring
kafka-eagle
Consumer lag monitoringOperations / Performance tools
sangrenel
KLoadGen - load generator plugin for jmeterOperations / Security
Kafka Security Manager
Kafka security playbookOperations / Audit
chaperone - A Kafka audit systemOperations / Mirroring
Message Handler For MirrorMaker to change topic names
uReplicator
MirrorTool for Kafka ConnectOperations / Backup
Backup and Restore topics & offsetsOperations / Tools
Kafka-Pixy - gRPC/REST Proxy
Kafka Proxy providing SASL/PLAIN authentication and SSL
Reactive/Akka API
kafkat
kt
Winton Kafka Streams
Spring-kafka
Maven quick start for Kafka Connect connectors
Trifecta
Strimzi Kafka CLIOperations / Metadata Management
Meteor is a scalable, easy-to-use, extensible metadata collection framework from the different cloud providers and on-prem sources and publish to Kafka
Go library for Kafka metadata in ZookeeperOperations / Schema Management
Stencil is a Protobuf schema registry for Kafka that enables you to create, maintain and consume protobuf messages and APIs dynamically, efficiently, and reliably
Schema Registry Transfer SMT
Expedia Stream RegistryOperations / UI
Kafdrop 3.x
– web UI for Kafka. For versions older than 0.10.0 use
kafka-manager
Kafka HQ
Kafka Webview
Kafkawize - self service topic management portal
Kadmin - Kafka Producer/Consumer UI
Kowl
Kafka Streams Topology Sketch Diagram Visualization
Web based GUIDeployment / Kubernetes
Strimzi
Operator for deploying and running Apache Kafka on Kubernetes
Kafka k8s operator
konsumerator - Kafka Consumer OperatorDeployment / Docker
Deployment / Integrations
hermes
IBMStreamsAlternative Implementations
GoProjects built on top of Kafka
In-Memory Cache Backed by KafkaUnsorted
Nothing in this list matches your filter.
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions awesome-kafka.
