deequ
by awslabs
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
AI summary
Data inspector
A library for testing data quality in large datasets
- stars
- 3.3K
- forks
- 541
- watching
- 80
- awesome lists
- 3
Similar projects
Found by comparing what the projects do, not just their names.
Data profiler
A Python API for defining unit tests for data quality in large datasets
Data processing library
A Python package that allows users to work with pandas DataFrames on top of Apache Spark
Deep learning framework
A PyTorch implementation on Apache Spark for distributed deep learning model training and inference.
Spark tutorials
Examples and tutorials for learning Spark using Java and Scala
Encryption-enabled analytics engine
A research-focused implementation of Apache Spark with homomorphic encryption support
Data exploration tool
An interactive web-based editor for exploring and analyzing large datasets using Scala, Apache Spark, and other data science tools
Spark tester
A testing helper library for Apache Spark applications.
NLP toolkit
Provides a set of pre-trained models and libraries for natural language processing tasks on top of Apache Spark
apache/spark40.2K
Data processor
An analytics engine designed to handle large-scale data processing and analysis
Spark runtime
Provides high-performance APIs for using Apache Spark with .NET
Data processor
A library that enables integration between Apache Spark and Apache Cassandra for fast data processing and analysis.
Formal verification adapter
An adaptation of ACSL by Example for SPARK 2014 to verify Ada programs with formal methods
DBMS library
A library that brings useful functions from various modern database management systems to Apache Spark
CoreNLP wrapper
Wraps Stanford CoreNLP annotators as Spark DataFrame functions for natural language processing tasks
Performance tester
A tool used to simulate heavy loads on servers and measure their performance under different conditions.
Featured in 3 awesome lists
Each link jumps to the spot where the list mentions deequ.
