Models

Available models

Model	ID	Supported parameters	Providers	Default Provider	Max Context	Retirement Date
Qwen3.5 4B Fast	qwen3.5-4b-32k-fast	max_tokens, temperature, stream	AssemblyAI	AssemblyAI	32768
Haiku 4.5	claude-haiku-4-5-20251001	max_tokens, temperature, tools, tool_choice, response_format, stream	AWS Bedrock	AWS Bedrock	200000
Haiku 5.5	claude-haiku-5-5	max_tokens, tools, tool_choice, response_format, stream, reasoning_effort	AWS Bedrock	AWS Bedrock	1000000
Opus 4.5	claude-opus-4-5-20251101	max_tokens, temperature, tools, tool_choice, response_format, stream	AWS Bedrock	AWS Bedrock	200000
Opus 4.6	claude-opus-4-6	max_tokens, temperature, tools, tool_choice, response_format, stream	AWS Bedrock	AWS Bedrock	200000
Opus 4.7	claude-opus-4-7	max_tokens, tools, tool_choice, response_format, stream, reasoning_effort	AWS Bedrock	AWS Bedrock	1000000
Opus 4.8	claude-opus-4-8	max_tokens, tools, tool_choice, response_format, stream, reasoning_effort	AWS Bedrock	AWS Bedrock	1000000
Opus 5	claude-opus-5	max_tokens, tools, tool_choice, response_format, stream, reasoning_effort	AWS Bedrock	AWS Bedrock	200000
Opus 5.5	claude-opus-5-5	max_tokens, tools, tool_choice, response_format, stream, reasoning_effort	AWS Bedrock	AWS Bedrock	1000000
Sonnet 4.5	claude-sonnet-4-5-20250929	max_tokens, temperature, tools, tool_choice, response_format, stream	AWS Bedrock	AWS Bedrock	200000
Sonnet 4.6	claude-sonnet-4-6	max_tokens, temperature, tools, tool_choice, response_format, stream, reasoning_effort	AWS Bedrock	AWS Bedrock	200000
Sonnet 5	claude-sonnet-5	max_tokens, tools, tool_choice, response_format, stream, reasoning_effort	AWS Bedrock	AWS Bedrock	200000
Sonnet 5.5	claude-sonnet-5-5	max_tokens, tools, tool_choice, response_format, stream, reasoning_effort	AWS Bedrock	AWS Bedrock	1000000
DeepSeek V4.1 Flash	deepseek-v4.1-flash	max_tokens, temperature, tools, tool_choice, response_format, reasoning_effort, stream	Digital Ocean, Fireworks	Digital Ocean	1048576
Gemini 2.5 Flash	gemini-2.5-flash	max_tokens, response_format, temperature, tools, tool_choice, stream, reasoning_effort	Vertex	Vertex	1048576
Gemini 2.5 Flash Lite	gemini-2.5-flash-lite	max_tokens, response_format, temperature, tools, tool_choice, stream	Vertex	Vertex	1048576
Gemini 2.5 Pro	gemini-2.5-pro	max_tokens, response_format, temperature, tools, tool_choice, stream, reasoning_effort	Vertex	Vertex	200000
Gemini 3.1 Flash Lite	gemini-3.1-flash-lite	max_tokens, response_format, temperature, tools, tool_choice, stream	Vertex	Vertex	1048575	2027-05-07
Gemini 3.5 Flash	gemini-3.5-flash	max_tokens, response_format, temperature, tools, tool_choice, stream, reasoning_effort	Vertex	Vertex	1048575
Gemini 3.5 Flash Lite	gemini-3.5-flash-lite	max_tokens, response_format, temperature, tools, tool_choice, stream, reasoning_effort	Vertex	Vertex	1048575
Gemini 3.6 Flash	gemini-3.6-flash	max_tokens, response_format, temperature, tools, tool_choice, stream, reasoning_effort	Vertex	Vertex	1048575
Gemini 3.7 Flash	gemini-3.7-flash	max_tokens, response_format, temperature, tools, tool_choice, stream, reasoning_effort	Vertex	Vertex	1048575
Gemini 3.8 Flash	gemini-3.8-flash	max_tokens, response_format, temperature, tools, tool_choice, stream, reasoning_effort	Vertex	Vertex	1048575
Gemini 4 Argon	gemini-4-argon	max_tokens, response_format, tools, tool_choice, stream, reasoning_effort	Vertex	Vertex	1048576
gemma-4-31b	gemma-4-31b	max_tokens, response_format, temperature, tools, tool_choice, stream, reasoning_effort	AWS Bedrock	AWS Bedrock	256000
Muse Spark Open	muse-spark-open	max_tokens, tools, tool_choice, response_format, stream, reasoning_effort	Fireworks	Fireworks	1000000
Minimax M3	minimax-m3	max_tokens, tools, tool_choice, response_format, stream, reasoning_effort	Fireworks	Fireworks	512000
Kimi K3	kimi-k3	max_tokens, tools, tool_choice, response_format, stream, reasoning_effort	AWS Bedrock, Fireworks	AWS Bedrock	1000000
Nemotron 3 Nano 30B A3B	nemotron-3-nano-30b-a3b	max_tokens, temperature, tools, tool_choice, response_format, stream	AWS Bedrock	AWS Bedrock	256000
Nemotron 3 Super 120B A12B	nemotron-3-super-120b-a12b	max_tokens, temperature, tools, tool_choice, response_format, stream	AWS Bedrock	AWS Bedrock	256000
Nemotron Lightning 3.5 30B A3B	nemotron-lightning-3p5-30b-a3b	max_tokens, temperature, tools, tool_choice, response_format, reasoning_effort, stream	Fireworks	Fireworks	262000
Nemotron Nano 9B v2	nemotron-nano-9b-v2	max_tokens, temperature, tools, tool_choice, response_format, stream	AWS Bedrock	AWS Bedrock	128000
GPT OSS 120B	gpt-oss-120b	max_tokens, response_format, temperature, tools, tool_choice	AWS Bedrock	AWS Bedrock	131072
GPT OSS 20B	gpt-oss-20b	max_tokens, temperature, tools, tool_choice	AWS Bedrock	AWS Bedrock	131072
GPT-4.1	gpt-4.1	max_tokens, temperature, tools, tool_choice, stream	Open AI	Open AI	1047576	2027-01-14
GPT-5	gpt-5	max_tokens, temperature, tools, tool_choice, stream, response_format	Open AI	Open AI	400000
GPT-5 Nano	gpt-5-nano	max_tokens, response_format, temperature, tools, tool_choice, stream	Open AI	Open AI	400000
GPT-5 mini	gpt-5-mini	max_tokens, response_format, temperature, tools, tool_choice, stream	Open AI	Open AI	400000
GPT-5.1	gpt-5.1	max_tokens, response_format, temperature, tools, tool_choice, stream, reasoning_effort	Open AI	Open AI	400000
GPT-5.2	gpt-5.2	max_tokens, response_format, temperature, tools, tool_choice, stream, reasoning_effort	Open AI	Open AI	400000
GPT-5.5	gpt-5.5	max_tokens, response_format, tools, tool_choice, stream, reasoning_effort	Open AI	Open AI	272000
GPT-5.6 Luna	gpt-5.6-luna	max_tokens, response_format, tools, tool_choice, stream, reasoning_effort	Open AI	Open AI	270000
GPT-5.6 Sol	gpt-5.6-sol	max_tokens, response_format, tools, tool_choice, stream, reasoning_effort	Open AI	Open AI	270000
GPT-5.6 Terra	gpt-5.6-terra	max_tokens, response_format, tools, tool_choice, stream, reasoning_effort	Open AI	Open AI	270000
GPT-6 Astra	gpt-6-astra	max_tokens, tools, tool_choice, stream, response_format, reasoning_effort	Open AI, AWS Bedrock	Open AI	270000
GPT-6 Luna	gpt-6-luna	max_tokens, tools, tool_choice, stream, response_format, reasoning_effort	AWS Bedrock, Open AI	AWS Bedrock	922000
GPT-6 Sol	gpt-6-sol	max_tokens, tools, tool_choice, stream, response_format, reasoning_effort	AWS Bedrock, Open AI	AWS Bedrock	922000
GPT-6.1 Sol	gpt-6.1-sol	max_tokens, stream, response_format, reasoning_effort	AWS Bedrock, Open AI	AWS Bedrock	922000
Qwen3 32B	qwen3-32B	max_tokens, temperature, tools, tool_choice, response_format, stream	AWS Bedrock	AWS Bedrock	200000
Qwen3 Next 80B A3B	qwen3-next-80b-a3b	max_tokens, temperature, tools, tool_choice, response_format, stream	AWS Bedrock	AWS Bedrock	200000
GLM-5.3	glm-5.3	max_tokens, temperature, tools, tool_choice, response_format, reasoning_effort, stream	Digital Ocean, Fireworks	Digital Ocean	1040000
GLM-5.3 Flash	glm-5.3-flash	max_tokens, temperature, tools, tool_choice, response_format, reasoning_effort, stream	Digital Ocean, Fireworks	Digital Ocean	1040000
Grok 4.7	grok-4.7	max_tokens, temperature, tools, tool_choice, stream, response_format, reasoning_effort	AWS Bedrock	AWS Bedrock	500000

Pricing details

Model	Parameter	Prompt (per 1M)	Completion (per 1M)	Cache read (per 1M)	Cache write (per 1M)	Cache write 1h (per 1M)	Regional surcharge
Qwen3.5 4B Fast	qwen3.5-4b-32k-fast	$0.1	$0.5
Haiku 4.5	claude-haiku-4-5-20251001	$1	$5	$0.1	$1.25	$2	+10%
Haiku 5.5	claude-haiku-5-5	$0.1	$0.5	$0.01	$0.125	$0.2	+10%
Opus 4.5	claude-opus-4-5-20251101	$5	$25	$0.5	$6.25	$10	+10%
Opus 4.6	claude-opus-4-6	$5	$25	$0.5	$6.25	$10	+10%
Opus 4.7	claude-opus-4-7	$5	$25	$0.5	$6.25	$10	+10%
Opus 4.8	claude-opus-4-8	$5	$25	$0.5	$6.25	$10	+10%
Opus 5	claude-opus-5	$5	$25	$0.5	$6.25	$10	+10%
Opus 5.5	claude-opus-5-5	$4	$20	$0.2	$5	$8	+10%
Sonnet 4.5	claude-sonnet-4-5-20250929	$3	$15	$0.3	$3.75	$6	+10%
Sonnet 4.6	claude-sonnet-4-6	$3	$15	$0.3	$3.75	$6	+10%
Sonnet 5	claude-sonnet-5	$3	$15	$0.3	$3.75	$6	+10%
Sonnet 5.5	claude-sonnet-5-5	$2	$10	$0.1	$2.5	$4	+10%
DeepSeek V4.1 Flash	deepseek-v4.1-flash	$0.3	$1.2	$0.006
Gemini 2.5 Flash	gemini-2.5-flash	$0.3	$2.5	$0.03			+10%
Gemini 2.5 Flash Lite	gemini-2.5-flash-lite	$0.1	$0.4	$0.01			+10%
Gemini 2.5 Pro	gemini-2.5-pro	$1.25	$10	$0.125			+10%
Gemini 3.1 Flash Lite	gemini-3.1-flash-lite	$0.25	$1.5	$0.025			+10%
Gemini 3.5 Flash	gemini-3.5-flash	$1.25	$9	$0.125			+10%
Gemini 3.5 Flash Lite	gemini-3.5-flash-lite	$0.3	$2.5	$0.03			+10%
Gemini 3.6 Flash	gemini-3.6-flash	$1.5	$7.5	$0.15			+10%
Gemini 3.7 Flash	gemini-3.7-flash	$0.75	$3.75	$0.075			+10%
Gemini 3.8 Flash	gemini-3.8-flash	$0.75	$3.75	$0.075			+10%
Gemini 4 Argon	gemini-4-argon	$2	$10	$0.1			+10%
gemma-4-31b	gemma-4-31b	$0.14	$0.4
Muse Spark Open	muse-spark-open	$1.25	$4.25	$0.15
Minimax M3	minimax-m3	$0.3	$1.2	$0.06
Kimi K3	kimi-k3	$3	$15	$0.3	$3.75		+10%
Nemotron 3 Nano 30B A3B	nemotron-3-nano-30b-a3b	$0.06	$0.24
Nemotron 3 Super 120B A12B	nemotron-3-super-120b-a12b	$0.15	$0.65
Nemotron Lightning 3.5 30B A3B	nemotron-lightning-3p5-30b-a3b	$0.05	$0.2	$0.01
Nemotron Nano 9B v2	nemotron-nano-9b-v2	$0.06	$0.23
GPT OSS 120B	gpt-oss-120b	$0.15	$0.6
GPT OSS 20B	gpt-oss-20b	$0.07	$0.3
GPT-4.1	gpt-4.1	$2	$8	$0.5			+10%
GPT-5	gpt-5	$1.25	$10	$0.125			+10%
GPT-5 Nano	gpt-5-nano	$0.05	$0.4	$0.005			+10%
GPT-5 mini	gpt-5-mini	$0.25	$2	$0.025			+10%
GPT-5.1	gpt-5.1	$1.25	$10	$0.125			+10%
GPT-5.2	gpt-5.2	$1.75	$14	$0.175			+10%
GPT-5.5	gpt-5.5	$5	$30	$0.5			+10%
GPT-5.6 Luna	gpt-5.6-luna	$0.2	$1.2	$0.02	$0.25		+10%
GPT-5.6 Sol	gpt-5.6-sol	$4	$20	$0.4	$5		+10%
GPT-5.6 Terra	gpt-5.6-terra	$2	$12	$0.2	$2.5		+10%
GPT-6 Astra	gpt-6-astra	$10	$50	$1	$12.5		+10%
GPT-6 Luna	gpt-6-luna	$0.1	$0.5	$0.01	$0.125		+10%
GPT-6 Sol	gpt-6-sol	$2	$10	$0.2	$2.5		+10%
GPT-6.1 Sol	gpt-6.1-sol	$2	$10	$0.1	$2.5		+10%
Qwen3 32B	qwen3-32B	$0.15	$0.6
Qwen3 Next 80B A3B	qwen3-next-80b-a3b	$0.15	$1.2
GLM-5.3	glm-5.3	$0.95	$3.4	$0.2
GLM-5.3 Flash	glm-5.3-flash	$0.15	$0.5	$0.03
Grok 4.7	grok-4.7	$2	$6	$0.5			+10%

Regional pricing overrides

Model	Parameter	Region	Prompt (per 1M)	Completion (per 1M)	Cache read (per 1M)
Nemotron 3 Nano 30B A3B	nemotron-3-nano-30b-a3b	US	$0.06	$0.24
Nemotron 3 Nano 30B A3B	nemotron-3-nano-30b-a3b	EU	$0.07	$0.28
Nemotron 3 Super 120B A12B	nemotron-3-super-120b-a12b	US	$0.15	$0.65
Nemotron 3 Super 120B A12B	nemotron-3-super-120b-a12b	EU	$0.18	$0.78
Nemotron Nano 9B v2	nemotron-nano-9b-v2	US	$0.06	$0.23
Nemotron Nano 9B v2	nemotron-nano-9b-v2	EU	$0.07	$0.27

For information on data retention and model training policies for each provider, see Data Retention and Model Training.

Head to our Playground to test out LLM Gateway without having to write any code!