Skip to content
My Docs My Docs letta-sdk
  • Auto
  • Light
  • Dark
DiscordForumGitHubSign up
Self-hosting
Model providers
More providers
Groq
View as Markdown
Copy Markdown
Open in Claude
Open in ChatGPT

Groq

You can use Letta with Groq if you have a Groq account and API key. Once you have set your GROQ_API_KEY in your environment variables, you can select what model and configure the context window size.

Enabling Groq with Docker

Section titled “Enabling Groq with Docker”

To enable Groq models when running the Letta server with Docker, set your GROQ_API_KEY as an environment variable:

Terminal window
# replace `~/.letta/.persist/pgdata` with wherever you want to store your agent data
docker run \
  -v ~/.letta/.persist/pgdata:/var/lib/postgresql/data \
  -p 8283:8283 \
  -e GROQ_API_KEY="your_groq_api_key" \
  letta/letta:latest

See the self-hosting guide for more information on running Letta with Docker.