pypi-duck-flow
by mehd-io
end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence
AI summary
Data pipeline
A data engineering project that extracts insights from Python projects using DuckDB and MotherDuck.
- stars
- 173
- forks
- 27
- watching
- 6
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Extension tracker
A repository tracking DuckDB extensions on GitHub, providing information about created date and last updated date.
Data pipeline builder
A tool that enables data analysts to create and manage data pipelines with an intuitive interface, generating Python code for deployment anywhere.
Pipeline builder
A tool for creating flexible and self-documenting data science pipelines
Data pipeline engine
A workflow engine for unifying feature engineering and machine learning operations in data analysis pipelines
Data pipeline tool
A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments
Data pipeline framework
A framework for designing and executing concurrent data pipelines with a focus on simplicity and efficiency
Data source wrapper
An extension for DuckDB that allows running SQL queries on arbitrary data sources using Python functions.
Data pipeline manager
A lightweight tool for managing and versioning large data alongside source code in data pipelines
Data pipeline processor
A library that provides a fluent interface for processing data pipelines in Python without holding large amounts of memory
Data pipeline framework
Provides a set of pre-defined data processing pipelines for pandas DataFrames.
ML pipeline builder
A Python package to build and experiment with machine learning pipelines using Kedro, MLflow, and other tools
nipype/pydra123
Dataflow engine
A lightweight Python dataflow engine for building and executing directed acyclic graphs (DAGs) in a scalable manner.
Data pipeline
A MongoDB pipeline extension for Scrapy spiders that enables real-time data insertion and buffering options.
Pipeline runner
A workflow management system designed to efficiently run pipelines in various environments.
Data-flow programming engine
A toolkit for expressing programs as directed acyclic graphs and wiring together computations over time-series data.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions pypi-duck-flow.
