sparkplug

Data fixer

A Spark-based package to apply data fixes using rule-based SQL conditions

Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌

GitHub

28 stars
7 watching
2 forks
Language: Scala
last commit: over 6 years ago
datapipelinesparkspark-sql

Related projects:

RepositoryDescriptionStars
databricks/spark-xmlA library that parses and queries XML data in Apache Spark504
apache/sparkAn analytics engine designed to handle large-scale data processing and analysis40,170
datastax/spark-cassandra-connectorA library that enables integration between Apache Spark and Apache Cassandra for fast data processing and analysis.1,944
willb/silexA library of reusable code for building scalable Spark applications19
datastax/spark-cassandra-stressA tool for testing the performance and stability of data integration between Apache Spark and Cassandra databases.25
databricks/spark-csvA library for parsing and querying CSV data with Apache Spark1,052
sparklyr/sparklyrAn R interface to Apache Spark for distributed data analysis and machine learning955
dotnet/sparkProvides high-performance APIs for using Apache Spark with .NET2,032
wanwizard/sparks-datamapperA PHP library that maps database tables into objects with automated relationship management and validation.51
mrpowers-io/spark-fast-testsA testing helper library for Apache Spark applications.437
tubular/sparklyA set of Python libraries and tools to simplify interactions with various data sources using Apache Spark.61
rougin/spark-plugA tool that simplifies testing and development with Codeigniter 3 by providing an application instance as a single variable.15
sparkica/dbpedia-extensionAn extension for Google Refine that adds columns to reconciled data from DBpedia39
lucidworks/spark-solrProvides tools to read data from Solr and write it to Spark DataFrames/RDDs, enabling integration with Solr.445
tdeckers/sparkcliA command-line interface to Cisco Spark14