spark-fast-tests

Spark tester

A testing helper library for Apache Spark applications.

Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)

GitHub

437 stars
16 watching
78 forks
Language: Scala
last commit: 11 days ago
Linked from 1 awesome list

sparktesting-framework

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
mrpowers-io/spark-daria A set of reusable tools to simplify Spark development in Scala 754
holdenk/spark-testing-base Base classes to facilitate testing with Spark 1,525
sparklyr/sparklyr An R interface to Apache Spark for distributed data analysis and machine learning 955
apache/spark An analytics engine designed to handle large-scale data processing and analysis 40,170
spiritlab/spark A research-focused implementation of Apache Spark with homomorphic encryption support 3
mrpowers/chispa A PySpark testing library providing helper methods with descriptive error messages 632
dotnet/spark Provides high-performance APIs for using Apache Spark with .NET 2,032
mrpowers-io/quinn Pyspark helper functions to maximize developer productivity 651
microsoft/mobius Provides a C# API for interacting with Apache Spark 941
amplab-extras/sparkr-pkg Provides a lightweight R interface to Apache Spark for data processing 641
flint-bot/sparky Provides a NodeJS API to interact with the Cisco Spark platform 16
sjrusso8/spark-connect-rs An experimental client for interacting with Apache Spark clusters from Rust. 91
kcrandall/emr_spark_automation Automates deployment of an AWS EMR cluster and execution of Spark jobs 8
ngmarmaduke/cisco_spark-ruby Provides a Ruby client for interacting with the Cisco Spark API 9
hydrospheredata/mist A platform for deploying and managing Spark applications in a serverless environment 326