Google Vertex AI

Tip

To enable Vertex AI models with Letta, set GOOGLE_CLOUD_PROJECT and GOOGLE_CLOUD_LOCATION in your environment variables.

You can use Letta with Vertex AI by configuring your GCP project ID and region.

Enabling Google Vertex AI with Docker

First, make sure you are authenticated with Google Vertex AI:

gcloud auth application-default login

To enable Google Vertex AI models when running the Letta server with Docker, set your GOOGLE_CLOUD_PROJECT and GOOGLE_CLOUD_LOCATION as environment variables:

# replace `~/.letta/.persist/pgdata` with wherever you want to store your agent data
docker run \
  -v ~/.letta/.persist/pgdata:/var/lib/postgresql/data \
  -p 8283:8283 \
  -e GOOGLE_CLOUD_PROJECT="your-project-id" \
  -e GOOGLE_CLOUD_LOCATION="us-central1" \
  letta/letta:latest

See the self-hosting guide for more information on running Letta with Docker.