sparkmagic
Spark Cluster Dev Tool
An open source library that enables interactive development of applications using remote Spark clusters
Jupyter magics and kernels for working with remote Spark clusters
1k stars
48 watching
447 forks
Language: Python
last commit: 8 days ago
Linked from 1 awesome list
clusterjupyterjupyter-notebookkerberoskernellivymagicnotebookpandas-dataframepysparksparksql-query
awesome-spark/awesome-sparkRelated projects:
| Repository | Description | Stars |
|---|---|---|
 tubular/sparkly | A set of Python libraries and tools to simplify interactions with various data sources using Apache Spark. | 60 |
 jupyter-widgets-contrib/ipygany | A Jupyter Notebook extension providing 3D scientific visualization capabilities with GPU acceleration. | 489 |
 nchammas/flintrock | A command-line tool for launching and managing Apache Spark clusters on AWS | 638 |
 sparklyr/sparklyr | An R interface to Apache Spark for distributed data analysis and machine learning | 957 |
 quantecon/sphinxcontrib-jupyter | An extension for generating Jupyter Notebooks from Sphinx documentation | 77 |
 apache/incubator-toree | A tool that enables interactive applications to connect to and use Apache Spark using the Scala programming language. | 740 |
 databricks/docker-spark-iceberg | A Docker-based environment for running Spark and Iceberg in a quick start scenario. | 256 |
 pixiedust/pixiedust | An add-on library for Jupyter notebooks to simplify data analysis and visualization | 1,041 |
 tylere/ee-jupyter-examples | A collection of Jupyter Notebook examples showcasing the use of the Earth Engine Python API | 87 |
 sciotaio/micropython-sparkplugb | An implementation of the Eclipse Sparkplug B Specification for MicroPython | 10 |
| apache/incubator-livy | An open-source REST interface for interacting with Apache Spark from anywhere. | 887 |
 barbagroup/jupyter-tutorial | An educational resource providing an introduction to Jupyter Notebook, including its use and applications. | 23 |
 lensacom/sparkit-learn | A Python library that integrates PySpark and scikit-learn for distributed machine learning | 1,154 |
 mwouts/itables | Enhances data visualization in Jupyter Notebooks by turning Pandas and Polars DataFrames into interactive tables. | 803 |
 krassowski/jupyter-manim | Enables display of video output from 3D animation software in Jupyter notebooks | 196 |