docker-spark-iceberg
by databricks
AI summary
Spark environment
A Docker-based environment for running Spark and Iceberg in a quick start scenario.
- stars
- 264
- forks
- 139
- watching
- 13
Similar projects
Found by comparing what the projects do, not just their names.
Spark Cluster Dev Tool
An open source library that enables interactive development of applications using remote Spark clusters
Spark container
A Docker image with Apache Spark pre-installed and configured for easy deployment on YARN clusters.
XML parser
A library that parses and queries XML data in Apache Spark
CSV parser
A library for parsing and querying CSV data with Apache Spark
Spark gateway
A tool to simplify running Spark on Kubernetes
Dataset processor
A lightweight Python implementation of Spark's RDD and DStream interfaces for improved performance on small datasets
Streaming environment
An environment for experimenting with real-time data processing using Kafka, Spark streaming, and Cassandra
CoreNLP wrapper
Wraps Stanford CoreNLP annotators as Spark DataFrame functions for natural language processing tasks
Data fixer
A Spark-based package to apply data fixes using rule-based SQL conditions
Spark interface
An R interface to Apache Spark for distributed data analysis and machine learning
apache/spark40.2K
Data processor
An analytics engine designed to handle large-scale data processing and analysis
TensorFlow Spark transformer
Enables manipulation of Apache Spark DataFrames using TensorFlow programs
Spark Data Processor
An introductory Scala app using Apache Spark Streaming to process data from Kafka and write summaries to Cassandra.
Docker tutorial
A comprehensive guide to Docker development and deployment
EMR automation tool
Automates deployment of an AWS EMR cluster and execution of Spark jobs
