porcupine
by YPares
Express parametrable, composable and portable data pipelines
AI summary
Data pipeline tool
A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments
- stars
- 89
- forks
- 11
- watching
- 43
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
Data pipeline framework
Provides a set of pre-defined data processing pipelines for pandas DataFrames.
Pipeline builder
A tool for creating flexible and self-documenting data science pipelines
Data pipeline framework
A framework for designing and executing concurrent data pipelines with a focus on simplicity and efficiency
Data pipeline engine
A workflow engine for unifying feature engineering and machine learning operations in data analysis pipelines
Data pipeline manager
A lightweight tool for managing and versioning large data alongside source code in data pipelines
Data pipeline tool
Enables real-time data synchronization between MongoDB and other systems.
Pipeline runner
A workflow management system designed to efficiently run pipelines in various environments.
Data pipeline processor
A library that provides a fluent interface for processing data pipelines in Python without holding large amounts of memory
pwwang/pipen105
Pipeline tool
A Python-based workflow automation framework that enables easy creation of data processing pipelines
Data pipeline framework
A platform-agnostic data processing framework for large-scale text data pipelines
Pipeline library
Parallel pipeline library for stream processing
Data pipeline tool
A continuous big data ingestion platform that enables easy creation of data pipelines for various data sources and destinations.
Pipeline manager
A tool for managing data science pipelines by automating build, testing, and deployment processes while ensuring correctness and performance.
Data pipeline
A data engineering project that extracts insights from Python projects using DuckDB and MotherDuck.
Pipeline library
A library that provides a concurrent, non-blocking buffered pipeline for structuring and scaling applications.
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions porcupine.
