kafka-connect-file-pulse
File processor
A tool that enables streaming and processing of various file formats into Apache Kafka
🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
324 stars
8 watching
66 forks
Language: Java
last commit: 11 months ago
Linked from 2 awesome lists
amazon-s3avroazure-storagecsvetlfile-streaminggoogle-cloudgrok-filterskafkakafka-connectkafka-connectorkafka-producerxml
semantalytics/awesome-kafka
dharmeshkakadia/awesome-kafkaRelated projects:
| Repository | Description | Stars |
|---|---|---|
 ibmstreams/streamsx.kafka | A toolkit for integrating Apache Kafka with Stream Processor SPL applications | 13 |
 nodefluent/kafka-streams | A Node.js library implementing Kafka Streams functionality for stream state processing and table representation. | 831 |
 mmolimar/kafka-connect-fs | A Kafka connector for reading records from file systems and loading them into Kafka. | 110 |
 wintoncode/winton-kafka-streams | A Python implementation of Apache Kafka's Streams API for building stream processing applications | 311 |
 confluentinc/ksql | A database for real-time stream processing applications built on top of Apache Kafka. | 133 |
| streamthoughts/azkarra-streams | A lightweight Java framework to develop and manage cloud-native streaming microservices based on Apache Kafka Streams. | 185 |
 lgouellec/streamiz | A .NET library for processing and aggregating stream data from Apache Kafka | 477 |
| confluentinc/kafka-connect-hdfs | A Kafka connector that enables data transfer between Kafka and Hadoop's Distributed File System | 15 |
 aiven-open/transforms-for-apache-kafka-connect | A collection of transformations for processing Apache Kafka records | 75 |
 snowflakedb/snowflake-kafka-connector | A plugin that enables data ingestion from Kafka topics to Snowflake tables | 141 |
 turbolytics/sql-flow | An open-source tool that enables writing Kafka stream processing logic using standard SQL syntax. | 73 |
 yaravind/kafka-connect-jenkins | Connects Jenkins with Kafka for data exchange | 30 |
| streamthoughts/kafka-monitoring-stack-docker-compose | Provides Docker Compose files to deploy a comprehensive Apache Kafka monitoring stack with Prometheus and Grafana. | 136 |
| nodefluent/kafka-connect | A framework to build connectors for transferring data between Apache Kafka and various datastores using JavaScript. | 128 |
 fgeller/kt | A command-line tool for interacting with Apache Kafka clusters | 947 |