AWS – AWS Batch now supports resource aware scheduling

AWS Batch now supports job scheduling that takes into account consumable resources (CRs) such as third-party license tokens, database access bandwidth, budgetary limits, and more. With resource aware scheduling you can set up sets of tokens representing these resources, which will then be consumed by the running AWS Batch jobs. This will help you reduce job failures and wasted compute time caused by missing or rate-limited resources, which in turn will improve utilization of infrastructure and reduce costs.

You can create, manage, and monitor consumption of your CRs using AWS Batch Management Console or the new AWS Batch consumable resource APIs such as CreateConsumableResource, DescribeConsumableResource, UpdateConsumableResource, DeleteConsumableResource, and ListJobsByConsumableResource. Once you set up your consumable resources, you can associate up to 5 CRs with your AWS Batch jobs while creating or updating AWS Batch job definitions. For more information, see Consumable Resources page in the AWS Batch User Guide, AWS Batch API Reference, and our AWS HPC Blog post.

AWS Batch supports developers, scientists, and engineers in running efficient batch processing for ML model training, simulations, and analysis at any scale. Resource aware scheduling is available for all types of AWS Batch compute environments in any AWS Region where AWS Batch is available.
 

Read More for the details.