datajob
Pipeline manager
Automates end-to-end machine learning pipeline deployment with AWS services
Build and deploy a serverless data pipeline on AWS with no effort.
111 stars
6 watching
19 forks
Language: Python
last commit: about 2 years ago
Linked from 1 awesome list
awsaws-cdkdata-pipelineglueglue-jobmachine-learningpipelinesagemakerserverlessstepfunctions
kalaiser/awesome-cdkRelated projects:
| Repository | Description | Stars |
|---|---|---|
 mmuller88/aws-cdk-staging-pipeline | An AWS CDK construct for automating the build, test, and deployment of applications using a staging pipeline | 7 |
 samapriya/planet-gee-pipeline-cli | A command-line tool for automating data processing and uploads from Planet's API to Google Earth Engine. | 42 |
 jgreenemi/parris | Automates the setup and training of machine learning algorithms on remote servers | 316 |
 databiosphere/toil | A workflow management system designed to efficiently run pipelines in various environments. | 901 |
 combust/mleap | Enables deployment of machine learning pipelines from Spark and Scikit-Learn to production | 1,506 |
 fluidattacks/makes | A framework for building and managing CI/CD pipelines and application environments with cryptographic signed dependencies. | 461 |
 kevin-hanselman/dud | A lightweight tool for managing and versioning large data alongside source code in data pipelines | 184 |
 apache/streampipes | A toolbox for industrial data analytics and stream processing | 614 |
 calebwin/pipelines | A language and runtime for crafting massively parallel data pipelines | 375 |
 linkedin/brooklin | A distributed system for streaming data between heterogeneous systems with high reliability and throughput at scale | 931 |
 awslabs/aws-codepipeline-jenkins-aws-codedeploy_linux | A sample AWS CodePipeline pipeline demonstrating a four-stage workflow with Jenkins and AWS Codedeploy | 50 |
 lightforever/mlcomp | A distributed framework for building and managing complex machine learning pipelines with a user-friendly interface. | 188 |
 jvalegre/robert | Automated machine learning protocols for cheminformatics using Python | 39 |
 cyrilwanner/next-serverless | Simplifies deployment of Next.js applications to AWS Lambda with minimal configuration | 81 |
 cdklabs/aws-delivlib | A tool for automating the build, testing, and publishing of code libraries to various package repositories | 375 |