AWS Bedrock

We support Anthropic models provided via AWS Bedrock.

Danger

To use a model with AWS Bedrock, you must ensure it is enabled in the your AWS Model Catalog. Letta will list all available Anthropic models on Bedrock, even if you do not have access to them via AWS.

Enabling AWS Bedrock with Docker

To enable AWS Bedrock models when running the Letta server with Docker, set your AWS credentials as environment variables:

# replace `~/.letta/.persist/pgdata` with wherever you want to store your agent data
docker run \
  -v ~/.letta/.persist/pgdata:/var/lib/postgresql/data \
  -p 8283:8283 \
  -e AWS_ACCESS_KEY_ID="your_aws_access_key_id" \
  -e AWS_SECRET_ACCESS_KEY="your_aws_secret_access_key" \
  -e AWS_DEFAULT_REGION="your_aws_default_region" \
  letta/letta:latest

Optionally, you can specify the API version (default is bedrock-2023-05-31):

-e BEDROCK_ANTHROPIC_VERSION="bedrock-2023-05-31"

See the self-hosting guide for more information on running Letta with Docker.