kafka-connect-file-pulse
File processor
A tool that enables streaming and processing of various file formats into Apache Kafka
🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
324 stars
8 watching
65 forks
Language: Java
last commit: 7 days ago
Linked from 2 awesome lists
amazon-s3avroazure-storagecsvetlfile-streaminggoogle-cloudgrok-filterskafkakafka-connectkafka-connectorkafka-producerxml
Related projects:
Repository | Description | Stars |
---|---|---|
ibmstreams/streamsx.kafka | A toolkit for integrating Apache Kafka with Stream Processor SPL applications | 13 |
nodefluent/kafka-streams | A Node.js library implementing Kafka Streams functionality for stream state processing and table representation. | 831 |
mmolimar/kafka-connect-fs | A Kafka connector for reading records from file systems and loading them into Kafka. | 110 |
wintoncode/winton-kafka-streams | A Python implementation of Apache Kafka's Streams API for stream processing applications | 313 |
confluentinc/ksql | A database for real-time stream processing applications built on top of Apache Kafka. | 125 |
streamthoughts/azkarra-streams | A lightweight Java framework to develop and manage cloud-native streaming microservices based on Apache Kafka Streams. | 186 |
lgouellec/streamiz | A .NET library for processing and aggregating stream data from Apache Kafka | 469 |
confluentinc/kafka-connect-hdfs | A Kafka connector that enables data transfer between Kafka and Hadoop's Distributed File System | 12 |
aiven-open/transforms-for-apache-kafka-connect | A collection of transformations for processing Apache Kafka records | 74 |
snowflakedb/snowflake-kafka-connector | A plugin that enables data ingestion from Kafka topics to Snowflake tables | 139 |
turbolytics/sql-flow | An open-source tool that enables writing Kafka stream processing logic using standard SQL syntax. | 69 |
yaravind/kafka-connect-jenkins | Connects Jenkins with Kafka for data exchange | 30 |
streamthoughts/kafka-monitoring-stack-docker-compose | Provides Docker Compose files to deploy a comprehensive Apache Kafka monitoring stack with Prometheus and Grafana. | 135 |
nodefluent/kafka-connect | A framework to build connectors for transferring data between Apache Kafka and various datastores using JavaScript. | 128 |
fgeller/kt | A command-line tool for interacting with Apache Kafka clusters | 948 |