Supported Models

Overview

Letta routinely runs automated scans against available providers and models. These are the results of the latest scan.

Ran 2512 tests against 157 models across 7 providers on June 27th, 2025

anthropic

Model	Basic	Token Streaming	Multimodal	Context Window	Last Scanned
claude-3-5-haiku-20241022	✅	✅	✅	200,000	2025-06-27
claude-3-5-sonnet-20240620	✅	✅	✅	200,000	2025-06-27
claude-3-5-sonnet-20241022	✅	✅	✅	200,000	2025-06-27
claude-3-7-sonnet-20250219	✅	✅	✅	200,000	2025-06-27
claude-opus-4-20250514	✅	✅	✅	200,000	2025-06-27
claude-sonnet-4-20250514	✅	✅	✅	200,000	2025-06-27
claude-3-opus-20240229	❌	✅	✅	200,000	2025-06-27
claude-3-haiku-20240307	❌	❌	✅	200,000	2025-06-27
claude-3-sonnet-20240229	❌	❌	❌	200,000	2025-06-27

---

openai

Model	Basic	Token Streaming	Multimodal	Context Window	Last Scanned
gpt-4-turbo	✅	✅	✅	128,000	2025-06-27
gpt-4-turbo-2024-04-09	✅	✅	✅	128,000	2025-06-27
gpt-4.1	✅	✅	✅	1,047,576	2025-06-27
gpt-4.1-2025-04-14	✅	✅	✅	1,047,576	2025-06-27
gpt-4.1-mini	✅	✅	✅	1,047,576	2025-06-27
gpt-4.1-mini-2025-04-14	✅	✅	✅	1,047,576	2025-06-27
gpt-4.1-nano	✅	✅	✅	1,047,576	2025-06-27
gpt-4.1-nano-2025-04-14	✅	✅	✅	1,047,576	2025-06-27
gpt-4o	✅	✅	✅	128,000	2025-06-27
gpt-4o-2024-05-13	✅	✅	✅	128,000	2025-06-27
gpt-4o-2024-08-06	✅	✅	✅	128,000	2025-06-27
gpt-4o-2024-11-20	✅	✅	✅	128,000	2025-06-27
gpt-4o-mini	✅	✅	✅	128,000	2025-06-27
gpt-4o-mini-2024-07-18	✅	✅	✅	128,000	2025-06-27
gpt-4-0613	✅	✅	❌	8,192	2025-06-27
gpt-4-1106-preview	✅	✅	❌	128,000	2025-06-27
gpt-4-turbo-preview	✅	✅	❌	128,000	2025-06-27
gpt-4-0125-preview	❌	✅	❌	128,000	2025-06-27
o1	❌	❌	✅	200,000	2025-06-27
o1-2024-12-17	❌	❌	✅	200,000	2025-06-27
o3	❌	❌	✅	200,000	2025-06-27
o3-2025-04-16	❌	❌	✅	200,000	2025-06-27
o4-mini	❌	❌	✅	30,000	2025-06-27
o4-mini-2025-04-16	❌	❌	✅	30,000	2025-06-27
gpt-4	❌	❌	❌	8,192	2025-06-27
o3-mini	❌	❌	❌	200,000	2025-06-27
o3-mini-2025-01-31	❌	❌	❌	200,000	2025-06-27
o3-pro	❌	❌	❌	30,000	2025-06-27
o3-pro-2025-06-10	❌	❌	❌	30,000	2025-06-27

---

google_ai

Model	Basic	Token Streaming	Multimodal	Context Window	Last Scanned
gemini-1.5-pro	✅	✅	✅	2,000,000	2025-06-27
gemini-1.5-pro-002	✅	✅	✅	2,000,000	2025-06-27
gemini-1.5-pro-latest	✅	✅	✅	2,000,000	2025-06-27
gemini-2.0-flash-thinking-exp	✅	✅	✅	1,048,576	2025-06-27
gemini-2.5-flash-preview-04-17	✅	✅	✅	1,048,576	2025-06-27
gemini-2.5-pro	✅	✅	✅	1,048,576	2025-06-27
gemini-2.5-pro-preview-03-25	✅	✅	✅	1,048,576	2025-06-27
gemini-2.5-pro-preview-05-06	✅	✅	✅	1,048,576	2025-06-27
gemini-2.5-flash	✅	❌	✅	1,048,576	2025-06-27
gemini-2.0-flash-thinking-exp-1219	❌	✅	✅	1,048,576	2025-06-27
gemini-2.5-flash-preview-04-17-thinking	❌	✅	✅	1,048,576	2025-06-27
gemini-2.5-flash-preview-05-20	❌	✅	✅	1,048,576	2025-06-27
gemini-2.5-pro-preview-06-05	❌	✅	✅	1,048,576	2025-06-27
gemini-2.0-flash-thinking-exp-01-21	❌	❌	✅	1,048,576	2025-06-27
gemini-2.5-flash-lite-preview-06-17	❌	❌	✅	1,048,576	2025-06-27
gemini-1.0-pro-vision-latest	❌	❌	❌	12,288	2025-06-27
gemini-1.5-flash	❌	❌	❌	1,000,000	2025-06-27
gemini-1.5-flash-002	❌	❌	❌	1,000,000	2025-06-27
gemini-1.5-flash-8b	❌	❌	❌	1,000,000	2025-06-27
gemini-1.5-flash-8b-001	❌	❌	❌	1,000,000	2025-06-27
gemini-1.5-flash-8b-latest	❌	❌	❌	1,000,000	2025-06-27
gemini-1.5-flash-latest	❌	❌	❌	1,000,000	2025-06-27
gemini-2.0-flash	❌	❌	❌	1,048,576	2025-06-27
gemini-2.0-flash-001	❌	❌	❌	1,048,576	2025-06-27
gemini-2.0-flash-exp	❌	❌	❌	1,048,576	2025-06-27
gemini-2.0-flash-exp-image-generation	❌	❌	❌	1,048,576	2025-06-27
gemini-2.0-flash-lite	❌	❌	❌	1,048,576	2025-06-27
gemini-2.0-flash-lite-001	❌	❌	❌	1,048,576	2025-06-27
gemini-2.0-flash-lite-preview	❌	❌	❌	1,048,576	2025-06-27
gemini-2.0-flash-lite-preview-02-05	❌	❌	❌	1,048,576	2025-06-27
gemini-2.0-flash-preview-image-generation	❌	❌	❌	32,768	2025-06-27
gemini-2.0-pro-exp	❌	❌	❌	1,048,576	2025-06-27
gemini-2.0-pro-exp-02-05	❌	❌	❌	1,048,576	2025-06-27
gemini-2.5-flash-preview-tts	❌	❌	❌	32,768	2025-06-27
gemini-2.5-pro-preview-tts	❌	❌	❌	65,536	2025-06-27
gemini-exp-1206	❌	❌	❌	1,048,576	2025-06-27
gemini-pro-vision	❌	❌	❌	12,288	2025-06-27

---

together

Model	Basic	Token Streaming	Multimodal	Context Window	Last Scanned
arcee-ai/coder-large	✅	✅	✅	32,768	2025-06-27
meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8	✅	✅	✅	1,048,576	2025-06-27
Qwen/Qwen2.5-Coder-32B-Instruct	✅	✅	❌	32,768	2025-06-27
meta-llama/Llama-3.3-70B-Instruct-Turbo	✅	✅	❌	131,072	2025-06-27
meta-llama/Llama-3.3-70B-Instruct-Turbo-Free	✅	✅	❌	131,072	2025-06-27
meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo	✅	✅	❌	130,815	2025-06-27
meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo	✅	✅	❌	131,072	2025-06-27
deepseek-ai/DeepSeek-V3	✅	❌	❌	131,072	2025-06-27
meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo	✅	❌	❌	131,072	2025-06-27
Qwen/Qwen2.5-72B-Instruct-Turbo	❌	✅	✅	131,072	2025-06-27
arcee-ai/virtuoso-large	❌	✅	✅	131,072	2025-06-27
arcee-ai/virtuoso-medium-v2	❌	✅	✅	131,072	2025-06-27
meta-llama/Llama-4-Scout-17B-16E-Instruct	❌	✅	✅	1,048,576	2025-06-27
Qwen/Qwen3-235B-A22B-fp8-tput	❌	✅	❌	40,960	2025-06-27
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF	❌	✅	❌	32,768	2025-06-27
scb10x/scb10x-llama3-1-typhoon2-70b-instruct	❌	✅	❌	8,192	2025-06-27
NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	❌	❌	✅	32,768	2025-06-27
Qwen/QwQ-32B	❌	❌	✅	131,072	2025-06-27
google/gemma-3n-E4B-it	❌	❌	✅	32,768	2025-06-27
mistralai/Mistral-7B-Instruct-v0.2	❌	❌	✅	32,768	2025-06-27
perplexity-ai/r1-1776	❌	❌	✅	163,840	2025-06-27
Qwen/Qwen2-72B-Instruct	❌	❌	❌	32,768	2025-06-27
Qwen/Qwen2-VL-72B-Instruct	❌	❌	❌	32,768	2025-06-27
Qwen/Qwen2.5-7B-Instruct-Turbo	❌	❌	❌	32,768	2025-06-27
Qwen/Qwen2.5-VL-72B-Instruct	❌	❌	❌	32,768	2025-06-27
arcee-ai/AFM-4.5B-Preview	❌	❌	❌	65,536	2025-06-27
arcee-ai/arcee-blitz	❌	❌	❌	32,768	2025-06-27
arcee-ai/caller	❌	❌	❌	32,768	2025-06-27
arcee-ai/maestro-reasoning	❌	❌	❌	131,072	2025-06-27
arcee_ai/arcee-spotlight	❌	❌	❌	131,072	2025-06-27
deepseek-ai/DeepSeek-R1	❌	❌	❌	163,840	2025-06-27
deepseek-ai/DeepSeek-R1-0528-tput	❌	❌	❌	163,840	2025-06-27
deepseek-ai/DeepSeek-R1-Distill-Llama-70B	❌	❌	❌	131,072	2025-06-27
deepseek-ai/DeepSeek-R1-Distill-Llama-70B-free	❌	❌	❌	8,192	2025-06-27
deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	❌	❌	❌	131,072	2025-06-27
deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	❌	❌	❌	131,072	2025-06-27
deepseek-ai/DeepSeek-V3-p-dp	❌	❌	❌	131,072	2025-06-27
google/gemma-2-27b-it	❌	❌	❌	8,192	2025-06-27
lgai/exaone-3-5-32b-instruct	❌	❌	❌	32,768	2025-06-27
lgai/exaone-deep-32b	❌	❌	❌	32,768	2025-06-27
meta-llama/Llama-3-70b-chat-hf	❌	❌	❌	8,192	2025-06-27
meta-llama/Llama-3-8b-chat-hf	❌	❌	❌	8,192	2025-06-27
meta-llama/Llama-3.2-11B-Vision-Instruct-Turbo	❌	❌	❌	131,072	2025-06-27
meta-llama/Llama-3.2-3B-Instruct-Turbo	❌	❌	❌	131,072	2025-06-27
meta-llama/Llama-3.2-90B-Vision-Instruct-Turbo	❌	❌	❌	131,072	2025-06-27
meta-llama/Llama-Vision-Free	❌	❌	❌	131,072	2025-06-27
meta-llama/Meta-Llama-3-70B-Instruct-Turbo	❌	❌	❌	8,192	2025-06-27
meta-llama/Meta-Llama-3-8B-Instruct-Lite	❌	❌	❌	8,192	2025-06-27
mistralai/Mistral-7B-Instruct-v0.1	❌	❌	❌	32,768	2025-06-27
mistralai/Mistral-7B-Instruct-v0.3	❌	❌	❌	32,768	2025-06-27
mistralai/Mistral-Small-24B-Instruct-2501	❌	❌	❌	32,768	2025-06-27
mistralai/Mixtral-8x7B-Instruct-v0.1	❌	❌	❌	32,768	2025-06-27
scb10x/scb10x-typhoon-2-1-gemma3-12b	❌	❌	❌	131,072	2025-06-27
togethercomputer/MoA-1	❌	❌	❌	32,768	2025-06-27
togethercomputer/MoA-1-Turbo	❌	❌	❌	32,768	2025-06-27
togethercomputer/Refuel-Llm-V2	❌	❌	❌	16,384	2025-06-27
togethercomputer/Refuel-Llm-V2-Small	❌	❌	❌	8,192	2025-06-27

---

deepseek

Model	Basic	Token Streaming	Multimodal	Context Window	Last Scanned
deepseek-chat	❌	❌	❌	64,000	2025-06-27
deepseek-reasoner	❌	❌	❌	64,000	2025-06-27

---

groq

Model	Basic	Token Streaming	Multimodal	Context Window	Last Scanned
allam-2-7b	❌	❌	❌	30,000	2025-06-27
compound-beta	❌	❌	❌	30,000	2025-06-27
compound-beta-mini	❌	❌	❌	30,000	2025-06-27
deepseek-r1-distill-llama-70b	❌	❌	❌	30,000	2025-06-27
distil-whisper-large-v3-en	❌	❌	❌	30,000	2025-06-27
gemma2-9b-it	❌	❌	❌	30,000	2025-06-27
llama-3.1-8b-instant	❌	❌	❌	30,000	2025-06-27
llama-3.3-70b-versatile	❌	❌	❌	30,000	2025-06-27
llama3-70b-8192	❌	❌	❌	30,000	2025-06-27
llama3-8b-8192	❌	❌	❌	30,000	2025-06-27
meta-llama/llama-4-maverick-17b-128e-instruct	❌	❌	❌	30,000	2025-06-27
meta-llama/llama-4-scout-17b-16e-instruct	❌	❌	❌	30,000	2025-06-27
meta-llama/llama-guard-4-12b	❌	❌	❌	30,000	2025-06-27
meta-llama/llama-prompt-guard-2-22m	❌	❌	❌	30,000	2025-06-27
meta-llama/llama-prompt-guard-2-86m	❌	❌	❌	30,000	2025-06-27
mistral-saba-24b	❌	❌	❌	30,000	2025-06-27
playai-tts	❌	❌	❌	30,000	2025-06-27
playai-tts-arabic	❌	❌	❌	30,000	2025-06-27
qwen-qwq-32b	❌	❌	❌	30,000	2025-06-27
qwen/qwen3-32b	❌	❌	❌	30,000	2025-06-27
whisper-large-v3	❌	❌	❌	30,000	2025-06-27
whisper-large-v3-turbo	❌	❌	❌	30,000	2025-06-27

---

letta

Model	Basic	Token Streaming	Multimodal	Context Window	Last Scanned
letta-free	❌	❌	❌	8,192	2025-06-27

---