amazon-kinesis-scaling-utils
Kinesis Utility
Provides a utility to manage Amazon Kinesis Streams scale and size based on predefined rules or observed data rates.
The Kinesis Scaling Utility is designed to give you the ability to scale Amazon Kinesis Streams in the same way that you scale EC2 Auto Scaling groups – up or down by a count or as a percentage of the total fleet. You can also simply scale to an exact number of Shards. There is no requirement for you to manage the allocation of the keyspace to Shards when using this API, as it is done automatically.
338 stars
47 watching
95 forks
Language: Java
last commit: 12 months ago
Linked from 1 awesome list
donnemartin/awesome-awsRelated projects:
| Repository | Description | Stars |
|---|---|---|
| awslabs/amazon-kinesis-aggregators | Automates real-time data aggregation and analysis on Amazon Kinesis streams | 151 |
| awslabs/amazon-kinesis-client | A client library for consuming and processing data from Amazon Kinesis Data Streams | 644 |
| awslabs/dynamodb-streams-kinesis-adapter | An adapter that allows applications to process data from DynamoDB Streams using the Kinesis API | 99 |
| awslabs/amazon-kinesis-client-nodejs | A Node.js library for building distributed applications that process streaming data with Amazon Kinesis | 297 |
| awslabs/amazon-kinesis-producer | A C++ library that enables efficient and reliable data ingestion into Amazon Kinesis topics | 400 |
 aws-samples/amazon-kinesis-learning | A tutorial project demonstrating near-real-time data processing using Amazon Kinesis Streams and Java. | 106 |
| awslabs/amazon-kinesis-client-ruby | An interface to process streaming data reliably at scale using Amazon Kinesis | 146 |
| awslabs/amazon-kinesis-client-net | An interface to process streaming data in distributed applications using Amazon Kinesis Client Library (KCL) | 62 |
| awslabs/amazon-kinesis-client-python | Provides an interface to Amazon Kinesis's MultiLangDaemon for Python developers | 370 |
| aws-samples/kinesis-poster-worker | A tool that simulates high-volume data ingestion into an AWS Kinesis stream using multiple threads. | 69 |
| awslabs/aws-fluent-plugin-kinesis | An Amazon Kinesis output plugin for Fluentd, enabling data stream integration. | 293 |
| awslabs/amazon-kinesis-video-streams-webrtc-sdk-c | Software development kit for real-time communication and streaming video/audio over the internet using Kinesis Video Streams | 1,039 |
 hariohmprasath/ecs-event-driven-scaling | An approach to scale SQS consumers in a container-based ecosystem using ECS and autoscaling | 3 |
| aws-samples/mqtt-kinesis-bridge | Connects an MQTT broker to a Kinesis stream | 41 |
 netflix/aws-autoscaling | Tools and documentation for using Auto Scaling to manage scalable cloud resources | 429 |