spark-operator
Spark manager
An operator that automates the lifecycle of Apache Spark applications on Kubernetes
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
3k stars
81 watching
1k forks
Language: Go
last commit: 10 days ago
Linked from 1 awesome list
apache-sparkgoogle-cloud-dataprockuberneteskubernetes-controllerkubernetes-crdkubernetes-operatorspark
rootsongjc/awesome-cloud-nativeRelated projects:
| Repository | Description | Stars |
|---|---|---|
 spark-jobserver/spark-jobserver | Provides a RESTful interface for managing Apache Spark jobs and contexts | 2,840 |
 kubernetes-sigs/kubebuilder | A framework for building Kubernetes APIs using custom resource definitions (CRDs) | 7,917 |
 kubevirt/kubevirt | Enables virtual machine management within Kubernetes clusters. | 5,638 |
 kotlin/kotlin-spark-api | Provides compatibility and extensions between Kotlin and Apache Spark for big data processing | 461 |
 vmware-tanzu/kubeapps | An in-cluster web-based application for deploying and managing applications on Kubernetes clusters | 4,996 |
 kcrandall/emr_spark_automation | Automates deployment of an AWS EMR cluster and execution of Spark jobs | 8 |
 dotnet/spark | Provides high-performance APIs for using Apache Spark with .NET | 2,023 |
 apple/batch-processing-gateway | A tool to simplify running Spark on Kubernetes | 181 |
| kubeflow/kubeflow | An ecosystem of Kubernetes-based components for each stage in the AI/ML lifecycle | 14,386 |
 kubehelper/kubehelper | Simplifies daily Kubernetes tasks through a web interface | 245 |
 kubernetes/kops | Automates creation, upgrade, and management of production-grade Kubernetes clusters on multiple cloud providers. | 15,968 |
 jahstreetorg/spark-on-kubernetes-helm | A Helm chart repository providing infrastructure templates for setting up a fully functional Spark on Kubernetes cluster with integrated services. | 199 |
 apache/spark | An analytics engine designed to handle large-scale data processing and analysis | 39,916 |
 operator-framework/operator-sdk | A toolkit to simplify building and managing complex stateful applications on Kubernetes | 7,258 |
 nchammas/flintrock | A command-line tool for launching and managing Apache Spark clusters on AWS | 638 |