AWS – Bottlerocket now supports NVIDIA Multi-Instance GPU (MIG) for Kubernetes workloads

Today, AWS has announced that Bottlerocket, the Linux-based operating system purpose-built for containers, now supports NVIDIA’s Multi-Instance GPU (MIG) feature, enabling customers to partition NVIDIA GPUs into multiple GPU instances on Kubernetes nodes. This capability allows system administrators to maximize GPU resource utilization by running multiple workloads simultaneously on a single GPU while maintaining hardware-level isolation between workloads.

With MIG support, customers can optimize GPU resource allocation for workloads that don’t fully utilize the GPU’s compute capacity, such as machine learning inference tasks. Each GPU partition operates with complete hardware-level memory and fault isolation, providing workload separation and reliable performance.

NVIDIA Multi-Instance GPU support in Bottlerocket is available in all commercial and AWS GovCloud (US) Regions where compatible NVIDIA GPU-enabled instances are offered. To learn more about MIG with the Bottlerocket NVIDIA variants, see the Bottlerocket User Guide. You can also visit the Bottlerocket product page and explore the Bottlerocket GitHub repository for more information.

Read More for the details.