datatrove
by huggingface
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
AI summary
Data pipeline framework
A platform-agnostic data processing framework for large-scale text data pipelines
- stars
- 2.1K
- forks
- 155
- watching
- 47
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Data pipeline framework
A framework for designing and executing concurrent data pipelines with a focus on simplicity and efficiency
Data pipeline framework
A software framework for building scalable, asynchronous data pipelines with explicit back-pressure management and logging capabilities.
Data pipeline framework
Provides a set of pre-defined data processing pipelines for pandas DataFrames.
Data pipeline tool
A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments
Pipeline runner
A workflow management system designed to efficiently run pipelines in various environments.
Data pipeline
A framework for orchestrating data collection, processing, and export
Data pipeline framework
A framework for managing data operations in BigQuery using SQL and software engineering best practices
Analysis tool
A platform for data-intensive scientific analysis and workflow management
Pipeline framework
A lightweight ETL framework providing a simple way to define and execute data transformation pipelines using declarative Python code.
Data pipeline processor
A library that provides a fluent interface for processing data pipelines in Python without holding large amounts of memory
Data pipeline engine
A workflow engine for unifying feature engineering and machine learning operations in data analysis pipelines
NLP pipeline framework
A software framework for building NLP and entity linking pipelines with semantic parsing, word sense disambiguation, and entity linking capabilities.
Data pipeline library
A library that enables the definition of complex data pipelines in a functional, typesafe, and efficient way using a declarative syntax
Pipeline builder
A tool for creating flexible and self-documenting data science pipelines
Data pipeline builder
A Java framework that simplifies Hadoop's MapReduce API to build efficient data processing pipelines
Featured in 1 awesome list
Each link jumps to the spot where the list mentions datatrove.
