Amazon Updates Bedrock With Custom Model Support
Written by Kay Ewbank   
Tuesday, 07 May 2024

Amazon has updated Bedrock, its tool for building with generative AI on AWS. The update adds support for importing custom models and evaluating models, as well as support for using Meta Llama 3 models and extra models from Mistral and Anthropic. 

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs). Generative AI apps are applications that can generate text, images, audio, and synthetic data in response to prompts.


The way developers use Amazon Bedrock is to experiment with a variety of FMs, customize them privately with the developer's own data using techniques such as fine-tuning and retrieval-augmented generation (RAG), and create managed agents that perform complex business tasks. The tool is designed to be used without writing any code.

The first improvement to the updated version is the ability to import custom FMs. Some of the models supported by Bedrock provide publicly available weights that can be fine-tuned and customized, and Bedrock now lets developers import custom weights for such models, and serve the custom model using On-Demand mode. The preview feature means developers can use Amazon Bedrock with existing customized models such as Code Llama, a code-specialized version of Llama 2 that was created by further training Llama 2 on code-specific datasets, or use your data to fine-tune models and import the resulting model in Amazon Bedrock.

A second improvement adds support for model evaluation, giving users the means to evaluate, compare, and select the best FMs for a particular use, based on either automatic or human evaluation. Automatic evaluation is based on predefined metrics such as accuracy, robustness, and toxicity. Subjective or custom metrics, such as friendliness, style, and alignment to brand voice, can be assessed via human evaluation workflows. 

Another addition, Guardrails for Amazon Bedrock, provides a way to implement safeguards when developing generative AI applications. Bedrock now lets you set up rules to ensure applications conform to your organization's responsible AI policies.

The updated release also comes with support for extra models from Mistral AI, including Mistral Large, and for Meta Llama 3 models. 

Amazon Bedrock is available now.



More Information

Amazon Bedrock

Related Articles

Amazon Releases Bedrock AI Tool

Amazon CodeGuru Now Available

Amazon's DeepRacer - Careful What You Wish For

Amazon's Giant Push Into Machine Learning

Amazon Redshift ML Now Generally Available

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.


New Eclipse Temurin OpenJDK Build Released

The Eclipse Foundation, together with the Adoptium Working Group, have announced the latest release of the Temurin Java SE runtime. This landmark release supports 54 version/platform combinations and  [ ... ]

Pharo 12 Adds New Breakpoint System

The latest version of Pharo, the open-source Smalltalk-inspired language and core library adds a new breakpoint model based on the debug point system.

More News

raspberry pi books



or email your comment to: