You can now use Amazon Elastic Kubernetes Service (EKS) to run containers on Amazon EC2 Inf1 Instances. With EKS and the AWS Neuron Kubernetes device plugin, it’s easy combine multiple Inferentia devices in your cluster to run high performance and cost-effective inference workloads at scale.
Read More for the details.