nextflow-spark

Spark wrapper

Provides a reusable set of Nextflow subworkflows and processes for creating transient Apache Spark clusters on any infrastructure.

GitHub

14 stars
4 watching
4 forks
Language: Nextflow
last commit: almost 4 years ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
microsoft/mobiusProvides a C# API for interacting with Apache Spark941
tubular/sparklyA set of Python libraries and tools to simplify interactions with various data sources using Apache Spark.61
gorillalabs/sparklingA Clojure API for interacting with Apache Spark448
ondra-m/ruby-sparkA Ruby wrapper around Apache Spark's functionality for large-scale data processing227
databricks/spark-corenlpWraps Stanford CoreNLP annotators as Spark DataFrame functions for natural language processing tasks422
sequenceiq/docker-sparkA Docker image with Apache Spark pre-installed and configured for easy deployment on YARN clusters.765
dotnet/sparkProvides high-performance APIs for using Apache Spark with .NET2,032
jfield44/sparksdkwrapperConvenience library to embed voice and video calling into an iOS app using the Cisco Spark SDK6
instaclustr/sample-kafkasparkcassandraAn introductory Scala app using Apache Spark Streaming to process data from Kafka and write summaries to Cassandra.23
flint-bot/sparkyProvides a NodeJS API to interact with the Cisco Spark platform16
cloudfroster/react-workflowA comprehensive React-based SPA boilerplate with various development tools and automation scripts.66
apache/sparkAn analytics engine designed to handle large-scale data processing and analysis40,170
rougin/spark-plugA tool that simplifies testing and development with Codeigniter 3 by providing an application instance as a single variable.15
joblib/joblib-sparkEnables parallelization of machine learning tasks on a distributed Spark cluster using the joblib library.243
databricks/tensorframesEnables manipulation of Apache Spark DataFrames using TensorFlow programs749