kafka-connect-file-pulse

File processor

A tool that enables streaming and processing of various file formats into Apache Kafka

🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka

GitHub

324 stars
8 watching
65 forks
Language: Java
last commit: 7 days ago
Linked from 2 awesome lists

amazon-s3avroazure-storagecsvetlfile-streaminggoogle-cloudgrok-filterskafkakafka-connectkafka-connectorkafka-producerxml

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
ibmstreams/streamsx.kafka A toolkit for integrating Apache Kafka with Stream Processor SPL applications 13
nodefluent/kafka-streams A Node.js library implementing Kafka Streams functionality for stream state processing and table representation. 831
mmolimar/kafka-connect-fs A Kafka connector for reading records from file systems and loading them into Kafka. 110
wintoncode/winton-kafka-streams A Python implementation of Apache Kafka's Streams API for stream processing applications 313
confluentinc/ksql A database for real-time stream processing applications built on top of Apache Kafka. 125
streamthoughts/azkarra-streams A lightweight Java framework to develop and manage cloud-native streaming microservices based on Apache Kafka Streams. 186
lgouellec/streamiz A .NET library for processing and aggregating stream data from Apache Kafka 469
confluentinc/kafka-connect-hdfs A Kafka connector that enables data transfer between Kafka and Hadoop's Distributed File System 12
aiven-open/transforms-for-apache-kafka-connect A collection of transformations for processing Apache Kafka records 74
snowflakedb/snowflake-kafka-connector A plugin that enables data ingestion from Kafka topics to Snowflake tables 139
turbolytics/sql-flow An open-source tool that enables writing Kafka stream processing logic using standard SQL syntax. 69
yaravind/kafka-connect-jenkins Connects Jenkins with Kafka for data exchange 30
streamthoughts/kafka-monitoring-stack-docker-compose Provides Docker Compose files to deploy a comprehensive Apache Kafka monitoring stack with Prometheus and Grafana. 135
nodefluent/kafka-connect A framework to build connectors for transferring data between Apache Kafka and various datastores using JavaScript. 128
fgeller/kt A command-line tool for interacting with Apache Kafka clusters 948