AWS – Amazon Kinesis Data Streams increases default shard limits to up to 20,000 per AWS account

Amazon Kinesis Data Streams now offers significantly higher default shard limits for data streams in Provisioned capacity mode, increasing from 500 to 20,000 shards per AWS account in the US East (N. Virginia), US West (Oregon), and Europe (Ireland) regions. You can also see an account’s utilization of the shards limit in any region via the AWS Service Quotas console, so you can grow streaming workloads easily and quickly to bring real-time insights to more use cases.

Amazon Kinesis Data Streams is a serverless data streaming service that allows customers to build de-coupled applications that publish and consume real-time data streams at any scale. A data stream is composed of shards, and each shard provides 1 MB/sec ingress and 2 MB/sec egress throughput capacity. You can easily change a stream’s throughput capacity by specifying its number of shards via the console, an API call, or the CLI. With the increased limits, customers using Provisioned mode can now process up to 10 GB/sec of ingress and 20 GB/sec of egress per account by default, and they can always request further increases to this limit.

The default shard limits have also been increased from 200 to 1,000 shards or 6,000 shards per account for all other regions. You can view the new defaults for all regions and request further increases via the Service Quotas console. For more information about how shard limits affect your data streams, see the Quotas and Limits documentation.

Read More for the details.