AWS – Amazon DynamoDB Streams adds supports for Kinesis Client Library (KCL) 3.0
Amazon DynamoDB Streams is a serverless data streaming feature that makes it straightforward to track, process, and react to item-level changes in DynamoDB tables in near real time. Today, DynamoDB has added support for KCL 3.0. With KCL 3.0, you can reduce compute costs to process streaming data by up to 33% compared to previous KCL versions. KCL 3.0 introduces an enhanced load balancing algorithm that continuously monitors resource utilization of the stream processing workers and automatically redistributes the load from over-utilized workers to other underutilized workers. Additionally, KCL 3.0 is built with the AWS SDK for Java 2.x for improved performance and security features, fully removing the dependency on the AWS SDK for Java 1.x.
Kinesis Client Library (KCL) is an open-source library that simplifies the development of stream processing applications with Amazon DynamoDB Streams. It manages complex tasks associated with distributed computing such as load balancing streaming data, processing data with fault-tolerance, and coordinating distributed workers, allowing you to solely focus on your core business logic. You can upgrade your stream processing application running on KCL 1.x by simply replacing the current library to use KCL 3.0 without any changes in your data processing logic. For migration instructions, see Migrating from KCL 1.x to KCL 3.x.
KCL 3.0 is available with Amazon DynamoDB Streams in all AWS Regions. To learn more, refer to Working with DynamoDB Streams in the DynamoDB Developer Guide.
Read More for the details.