batch-processing-gateway

Spark gateway

A tool to simplify running Spark on Kubernetes

The gateway component to make Spark on K8s much easier for Spark users.

GitHub

181 stars
15 watching
38 forks
Language: Java
last commit: 5 months ago
Linked from 1 awesome list

batch-processingk8skubernetesspark

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
databricks/docker-spark-iceberg A Docker-based environment for running Spark and Iceberg in a quick start scenario. 256
sequenceiq/docker-spark A Docker image with Apache Spark pre-installed and configured for easy deployment on YARN clusters. 765
jupyter-incubator/sparkmagic An open source library that enables interactive development of applications using remote Spark clusters 1,331
flint-bot/sparky Provides a NodeJS API to interact with the Cisco Spark platform 16
apache/spark An analytics engine designed to handle large-scale data processing and analysis 40,002
amplab-extras/sparkr-pkg Provides a lightweight R interface to Apache Spark for data processing 641
sjrusso8/spark-connect-rs An experimental client for interacting with Apache Spark clusters from Rust. 90
mongodb/mongo-spark A Java-based connector for integrating MongoDB with Apache Spark 712
nchammas/flintrock A command-line tool for launching and managing Apache Spark clusters on AWS 638
brh55/generator-spark-bot A yeoman generator for building event-driven Cisco Spark bots with simplicity and usability in mind. 6
kcrandall/emr_spark_automation Automates deployment of an AWS EMR cluster and execution of Spark jobs 8
sw1sh/frege-spark An effort to integrate Apache Spark with the Frege programming language 5
gorillalabs/sparkling A Clojure API for interacting with Apache Spark 448
jahstreetorg/spark-on-kubernetes-helm A Helm chart repository providing infrastructure templates for setting up a fully functional Spark on Kubernetes cluster with integrated services. 199
jorgebucaran/spark.fish A Fish script that displays sparklines in the terminal to visualize data ranges or sequences. 347