batch-processing-gateway
Spark gateway
A tool to simplify running Spark on Kubernetes
The gateway component to make Spark on K8s much easier for Spark users.
181 stars
15 watching
38 forks
Language: Java
last commit: 5 months ago
Linked from 1 awesome list
batch-processingk8skubernetesspark
Related projects:
Repository | Description | Stars |
---|---|---|
databricks/docker-spark-iceberg | A Docker-based environment for running Spark and Iceberg in a quick start scenario. | 256 |
sequenceiq/docker-spark | A Docker image with Apache Spark pre-installed and configured for easy deployment on YARN clusters. | 765 |
jupyter-incubator/sparkmagic | An open source library that enables interactive development of applications using remote Spark clusters | 1,331 |
flint-bot/sparky | Provides a NodeJS API to interact with the Cisco Spark platform | 16 |
apache/spark | An analytics engine designed to handle large-scale data processing and analysis | 40,002 |
amplab-extras/sparkr-pkg | Provides a lightweight R interface to Apache Spark for data processing | 641 |
sjrusso8/spark-connect-rs | An experimental client for interacting with Apache Spark clusters from Rust. | 90 |
mongodb/mongo-spark | A Java-based connector for integrating MongoDB with Apache Spark | 712 |
nchammas/flintrock | A command-line tool for launching and managing Apache Spark clusters on AWS | 638 |
brh55/generator-spark-bot | A yeoman generator for building event-driven Cisco Spark bots with simplicity and usability in mind. | 6 |
kcrandall/emr_spark_automation | Automates deployment of an AWS EMR cluster and execution of Spark jobs | 8 |
sw1sh/frege-spark | An effort to integrate Apache Spark with the Frege programming language | 5 |
gorillalabs/sparkling | A Clojure API for interacting with Apache Spark | 448 |
jahstreetorg/spark-on-kubernetes-helm | A Helm chart repository providing infrastructure templates for setting up a fully functional Spark on Kubernetes cluster with integrated services. | 199 |
jorgebucaran/spark.fish | A Fish script that displays sparklines in the terminal to visualize data ranges or sequences. | 347 |