Skip to main content

AWS Bedrock Models

Model Support updated: August 8, 2024

Model availability in AWS Bedrock is region dependent. The two primary regions are US-East-1 and US-West-2. Below is the list of TrustGraph compatible models supported through the AWS Bedrock API for US-East-1:

  • Claude 3 Sonnet
  • Claude 3 Haiku
  • Llama 3 8B Instruct
  • Llama 3 70B Instruct
  • Mistral 7B Instruct
  • Mixtral 8x7B Instruct
  • Mistral Large (24.02)
  • Mistral Small (24.02)

Below is the list of TrustGraph compatible models supported through the AWS Bedrock API for US-West-2:

  • Claude 3 Sonnet
  • Claude 3 Haiku
  • Llama 3.1 405B Instruct
  • Llama 3.1 70B Instruct
  • Llama 3.1 8B Instruct
  • Llama 3 8B Instruct
  • Llama 3 70B Instruct
  • Mistral Large 2 (24.07)
  • Mistral 7B Instruct
  • Mixtral 8x7B Instruct
  • Mistral Large (24.02)
warning

Testing with Llama 3.1 405B Instruct has been problematic. Since the other Llama 3.1 models work with TrustGraph, we can only assume that AWS Bedrock is currently experiencing demand issues for Llama 3.1 405B Instruct. In general, Llama 3.1 models have performed poorly in extraction tests with TrustGraph and are not recommended, especially in comparison to other models in the 7B-9B parameter range.

caution

Model access in AWS Bedrock must be requested in each region you intend to use. Most models are not available by default. Access, however, is usually granted immediately upon request within AWS.

tip

Other models are avaiable through AWS Bedrock, but have not been tested. The AWS Bedrock API is not consistent, with different models forming their input and outputs in slightly different structures. TrustGraph should be able to support any other models within AWS Bedrock but may require slight modifications.