sparkly

Spark wrapper

A set of Python libraries and tools to simplify interactions with various data sources using Apache Spark.

Helpers & syntactic sugar for PySpark.

GitHub

61 stars
42 watching
9 forks
Language: Python
last commit: about 3 years ago
Linked from 1 awesome list

pysparkpythonspark

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
brbester/pyciscosparkProvides an interface to the Cisco Spark REST API30
gorillalabs/sparklingA Clojure API for interacting with Apache Spark448
svenkreiss/pysparklingA lightweight Python implementation of Spark's RDD and DStream interfaces for improved performance on small datasets262
janeliascicomp/nextflow-sparkProvides a reusable set of Nextflow subworkflows and processes for creating transient Apache Spark clusters on any infrastructure.14
sparklyr/sparklyrAn R interface to Apache Spark for distributed data analysis and machine learning955
microsoft/mobiusProvides a C# API for interacting with Apache Spark941
jupyter-incubator/sparkmagicAn open source library that enables interactive development of applications using remote Spark clusters1,334
amplab-extras/sparkr-pkgProvides a lightweight R interface to Apache Spark for data processing641
ondra-m/ruby-sparkA Ruby wrapper around Apache Spark's functionality for large-scale data processing227
sciotaio/micropython-sparkplugbAn implementation of the Eclipse Sparkplug B Specification for MicroPython10
spiraldb/ziggy-pydustA toolkit for building Python extensions in Zig.437
flint-bot/sparkyProvides a NodeJS API to interact with the Cisco Spark platform16
ankurchavda/sparklearningA comprehensive resource for learning Apache Spark, covering its core concepts, components, and advanced topics.655
hypjudy/sparklesDevelops multimodal instruction-following models for open-ended dialogues across multiple images43
lensacom/sparkit-learnA Python library that integrates PySpark and scikit-learn for distributed machine learning1,154