Voice Agents

Experimental

Voice agents

All Letta agents can be connected to a voice provider by using the OpenAI-compatible streaming chat completions endpoint at https://api.letta.com/v1/chat/completions. Any standard Letta agent can be used for voice applications.

Creating a voice agent

You can create a voice agent using the standard Letta agent creation flow:

from letta_client import Letta
import os

client = Letta(token=os.getenv('LETTA_API_KEY'))

# create the Letta agent
agent = client.agents.create(
    memory_blocks=[
        {"value": "Name: ?", "label": "human"},
        {"value": "You are a helpful assistant.", "label": "persona"},
    ],
    model="openai/gpt-4o-mini"  # Use 4o-mini for speed
)

You can attach additional tools and blocks to this agent just as you would any other Letta agent.