sparklyr

Spark interface

An R interface to Apache Spark for distributed data analysis and machine learning

R interface for Apache Spark

GitHub

955 stars
73 watching
310 forks
Language: R
last commit: almost 2 years ago
Linked from 1 awesome list

apache-sparkdistributeddplyridelivymachine-learningrremote-clustersrstatssparksparklyr

Screenshot of sparklyr/sparklyr website

spark.rstudio.com/

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
amplab-extras/sparkr-pkgProvides a lightweight R interface to Apache Spark for data processing641
ondra-m/ruby-sparkA Ruby wrapper around Apache Spark's functionality for large-scale data processing227
apache/incubator-livyAn open-source REST interface for interacting with Apache Spark from anywhere.894
tubular/sparklyA set of Python libraries and tools to simplify interactions with various data sources using Apache Spark.61
sjrusso8/spark-connect-rsAn experimental client for interacting with Apache Spark clusters from Rust.91
ngmarmaduke/cisco_spark-rubyProvides a Ruby client for interacting with the Cisco Spark API9
ankurchavda/sparklearningA comprehensive resource for learning Apache Spark, covering its core concepts, components, and advanced topics.655
apache/sparkAn analytics engine designed to handle large-scale data processing and analysis40,170
mrpowers-io/spark-fast-testsA testing helper library for Apache Spark applications.437
dotnet/sparkProvides high-performance APIs for using Apache Spark with .NET2,032
harryprince/geosparkEnables spatial analysis in Apache Spark using SF functions58
dmmiller612/sparktorchA PyTorch implementation on Apache Spark for distributed deep learning model training and inference.339
gorillalabs/sparklingA Clojure API for interacting with Apache Spark448
lensacom/sparkit-learnA Python library that integrates PySpark and scikit-learn for distributed machine learning1,154
kcrandall/emr_spark_automationAutomates deployment of an AWS EMR cluster and execution of Spark jobs8