sample-KafkaSparkCassandra

Spark Data Processor

An introductory Scala app using Apache Spark Streaming to process data from Kafka and write summaries to Cassandra.

Introductory sample scala app using Apache Spark Streaming to accept data from Kafka and write a summary to Cassandra.

GitHub

23 stars
38 watching
23 forks
Language: Scala
last commit: almost 8 years ago
Linked from 1 awesome list

netapp-public

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
instaclustr/sample-sparkjobservercassandraDemonstrates using Spark Jobserver to run Apache Spark analytics with Cassandra2
instaclustr/sample-sparkcassandrawithsslA Spark job demonstrating Cassandra data analytics with SSL encryption1
apache/sparkAn analytics engine designed to handle large-scale data processing and analysis40,170
datastax/spark-cassandra-connectorA library that enables integration between Apache Spark and Apache Cassandra for fast data processing and analysis.1,944
svenkreiss/pysparklingA lightweight Python implementation of Spark's RDD and DStream interfaces for improved performance on small datasets262
ibmstreams/streamsx.kafkaA toolkit for integrating Apache Kafka with Stream Processor SPL applications13
microsoft/mobiusProvides a C# API for interacting with Apache Spark941
internetarchive/sparklingA data processing library built on top of Apache Spark to handle temporal web data11
dibbhatt/kafka-spark-consumerA tool for consuming messages from Kafka topics using Spark Streaming while maintaining reliability and handling failures635
spiritlab/sparkA research-focused implementation of Apache Spark with homomorphic encryption support3
irvingc/dbscan-on-sparkAn implementation of the DBSCAN clustering algorithm on top of Apache Spark184
yannael/kafka-sparkstreaming-cassandraAn environment for experimenting with real-time data processing using Kafka, Spark streaming, and Cassandra97
databricks/spark-corenlpWraps Stanford CoreNLP annotators as Spark DataFrame functions for natural language processing tasks422
databricks/spark-csvA library for parsing and querying CSV data with Apache Spark1,052
janeliascicomp/nextflow-sparkProvides a reusable set of Nextflow subworkflows and processes for creating transient Apache Spark clusters on any infrastructure.14