spark-euca

Big Data Deployment Tools

Provides scripts to deploy multiple big data tools in a managed environment using Eucalyptus and Amazon AWS

Scripts to setup Apache Mesos, Spark, Hadoop, Storm, Kafka and Hama on Eucalyptus and Amazon AWS. Spark can also be deployed as a standalone cluster.

GitHub

1 stars
1 watching
0 forks
Language: Python
last commit: about 7 years ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
stratio/sparta A platform that streamlines real-time data analytics and processing using Apache Spark and other technologies 525
hydrospheredata/mist A platform for deploying and managing Spark applications in a serverless environment 326
bustle/shep Automates deployment of serverless APIs and Lambda functions to AWS API Gateway and Lambda 378
dotnet/spark Provides high-performance APIs for using Apache Spark with .NET 2,032
nchammas/flintrock A command-line tool for launching and managing Apache Spark clusters on AWS 637
caltechads/deployfish Tools and frameworks to manage the lifecycle of AWS ECS services and tasks 90
kcrandall/emr_spark_automation Automates deployment of an AWS EMR cluster and execution of Spark jobs 8
aws-samples/ecs-canary-blue-green-deployment An automated canary deployment strategy for Amazon ECS using Route53 weights and Step Functions to transition traffic between two ECS services. 168
combust/mleap Enables deployment of machine learning pipelines from Spark and Scikit-Learn to production 1,506
aws-samples/ecs-blue-green-deployment A reference architecture for automated blue-green deployments on Amazon ECS using CloudFormation templates and AWS Code* services. 463
harsha2010/magellan A distributed geospatial analytics engine on top of Apache Spark 533
apache/spark An analytics engine designed to handle large-scale data processing and analysis 40,170
crownedgrouse/geas An Erlang application scattering tool that analyzes dependencies and releases to determine a project's safe deployment window 109
microsoft/mobius Provides a C# API for interacting with Apache Spark 941
otrf/blacksmith Provides dynamic templates for provisioning cloud infrastructure and deploying applications in the cloud. 317