AWS – Meta Llama 3.1 405B now generally available in Amazon Bedrock

The most advanced Meta Llama models to date, Llama 3.1, are available in Amazon Bedrock. Starting today, the Llama 3.1 405B model is now generally available in Amazon Bedrock. Amazon Bedrock offers a turnkey way to build generative AI applications with Llama. Llama 3.1 models are a collection of 8B, 70B, and 405B parameter size models offering new capabilities for your generative AI applications.

All Llama 3.1 models demonstrate significant improvements over previous versions. The models support a 128K context length and exhibit improved reasoning for multilingual dialogue use cases in eight languages. The models access more information from lengthy text to make more informed decisions and leverage richer contextual data to generate more subtle and refined responses. According to Meta, Llama 3.1 405B is one of the best and largest publicly available foundation models and is well suited for synthetic data generation and model distillation. Llama 3.1 models also provide state-of-the-art capabilities in general knowledge, math, tool use, and multilingual translation.

Meta’s Llama 3.1 models are generally available in Amazon Bedrock in the US West (Oregon) Region. To learn more, read the AWS News launch blog, Llama in Amazon Bedrock product page, pricing page, and documentation. To get started with Llama 3.1 in Amazon Bedrock, visit the Amazon Bedrock console.

Read More for the details.