lambda-refarch-fileprocessing
File Processing Engine
An event-driven architecture for real-time file processing using AWS Lambda and SQS queues
Serverless Reference Architecture for Real-time File Processing
463 stars
71 watching
175 forks
Language: Python
last commit: over 3 years agoLinked from 1 awesome list
donnemartin/awesome-awsRelated projects:
| Repository | Description | Stars |
|---|---|---|
| aws-samples/lambda-refarch-iotbackend | An event-driven architecture for processing IoT data with AWS Lambda and IoT Core | 253 |
| aws-samples/lambda-refarch-mobilebackend | An end-to-end reference architecture for building a mobile backend using AWS Lambda and other services. | 587 |
| aws-samples/lambda-ecs-worker-pattern | This code example illustrates how to extend AWS Lambda functionality using Amazon SQS and the Amazon EC2 Container Service (ECS) to process large tasks outside of Lambda's execution time limit. | 290 |
 grailbio/reflow | A system for incremental data processing in the cloud that enables scientists and engineers to compose and execute programs transparently parallelized and memoized. | 965 |
 nficano/python-lambda | A toolset for bundling and deploying Python code in AWS Lambda | 1,501 |
| aws-samples/amazon-elasticsearch-lambda-samples | A sample code project for streaming data to Amazon Elasticsearch Service using AWS Lambda | 391 |
 theam/aws-lambda-haskell-runtime | A Haskell runtime specifically designed to run on AWS Lambda | 270 |
 aws/aws-lambda-builders | A Python library to compile and package AWS Lambda functions for various runtimes and frameworks | 342 |
 awslabs/aws-security-automation | Automated incident response and security remediation tools for AWS services | 620 |
| aws-samples/aws-python-sample | A Python application demonstrating AWS SDK usage for storing and managing data in Amazon S3 | 200 |
| aws/aws-lambda-java-libs | A collection of libraries providing essential components for building Java applications on the AWS Lambda platform. | 521 |
| aws-samples/reinvent2015-dev309 | Provides sample code examples for processing large-scale metrics in Ruby using Hadoop and Amazon Redshift | 7 |
 tdsis/lambda-forest | A framework that simplifies the development of RESTful APIs using AWS Lambda and API Gateway | 2 |
| awslabs/aws-lambda-redshift-loader | An AWS Lambda function that automates data loading from Amazon S3 into an Amazon Redshift database cluster | 597 |
 ibm-cloud-architecture/refarch-ml-ops | A reference architecture and starter kit for operationalizing machine learning models in production environments. | 37 |