Every model you can call through AIgateway, ranked by the benchmarks engineers actually care about: SWE-bench for agentic coding, MMLU + GPQA for reasoning, HumanEval for code generation — plus input and output price per 1M tokens and context window size. Numbers are sourced from each provider's reported eval results; blank cells mean the lab has not published that benchmark. Sort any column. The same data is available as JSON at /api/leaderboard.
1157 models across 90 providers. Every row is a click away from a full model page with pricing, quickstart code, and a live playground.
| Model | Provider | SWE-bench | MMLU | GPQA | HumanEval | Input $/M | Output $/M | Context |
|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 anthropic/claude-sonnet-5.5 | Anthropic | — | — | — | — | $2.00 | $10.00 | 1M |
| GPT-6.1 Sol openai/gpt-6.1-sol | OpenAI | — | — | — | — | $2.00 | $10.00 | 1.1M |
| Claude Opus 5.5 anthropic/claude-opus-5.5 | Anthropic | — | — | — | — | $4.00 | $20.00 | 1M |
| Grok 4.7 xai/grok-4.7 | xAI | — | — | — | — | $2.00 | $6.00 | 500K |
| Glm-5.3 zai-org/glm-5.3 | Zai-org | — | — | — | — | $1.40 | $4.40 | 1.0M |
| Kimi K3 moonshot/kimi-k3 | Moonshot | — | — | — | — | $3.00 | $15.00 | 1.0M |
| Qwen3.8-Max alibaba/qwen3.8-max | Alibaba | — | — | — | — | $2.00 | $6.00 | 1M |
| GPT-5.6 Sol openai/gpt-5.6-sol | OpenAI | — | — | — | — | $2.00 | $10.00 | 1.1M |
| Qwen3.8-27b qwen/qwen3.8-27b | Alibaba Qwen | — | — | — | — | $0.45 | $3.20 | 262K |
| GLM-5.3-Prime zai-org/glm-5.3-prime | Z.ai | — | — | — | — | $2.80 | $8.80 | 1M |
| Pareto unbiased/pareto | Unbiased | — | — | — | — | $2.50 | $7.50 | 262K |
| Gemini 3.1 Pro google/gemini-3.1-pro | — | 89.6 | — | — | $2.00 | $12.00 | 1M | |
| GPT-5.5 Pro openai/gpt-5.5-pro | OpenAI | — | — | — | — | $30.00 | $180.00 | 1M |
| MiniMax M3 minimax/m3 | MiniMax | — | — | — | — | $0.30 | $1.20 | 1M |
| Kimi-K2.6 moonshot/kimi-k2.6 | Moonshot | 68.2 | — | — | 92.7 | $0.95 | $4.00 | 262K |
| O3 openai/o3 | OpenAI | — | — | — | — | $2.00 | $8.00 | 200K |
| Gemini 2.5 Pro google/gemini-2.5-pro | — | — | — | — | $1.25 | $10.00 | 1M | |
| Gemini 2.5 Flash google/gemini-2.5-flash | — | — | — | — | $0.30 | $2.50 | 1M | |
| Nemotron-3-120b-A12b nvidia/nemotron-3-120b-a12b | Nvidia | — | — | — | — | $0.50 | $1.50 | 256K |
| Gpt-Oss-120b openai/gpt-oss-120b | OpenAI | — | — | — | — | $0.35 | $0.75 | 128K |
| Gemma-2b-IT-Lora google/gemma-2b-it-lora | — | — | — | — | $0.030 | $0.060 | 8K | |
| Llama-3.2-3b-Instruct meta/llama-3.2-3b-instruct | Meta | — | — | — | — | $0.051 | $0.34 | 80K |
| Mistral-7b-Instruct-V0.2-Lora mistral/mistral-7b-instruct-v0.2-lora | Mistral | — | — | — | — | $0.050 | $0.10 | 15K |
| Kimi-K2.7-Code moonshot/kimi-k2.7-code | Moonshot | — | — | — | — | $0.95 | $4.00 | 262K |
| Eurollm-9b-IT utter-project/eurollm-9b-it | Utter-project | — | — | — | — | $0.10 | $0.20 | 32K |
| Llama-3.1-8b-Instruct-Fp8 meta/llama-3.1-8b-instruct-fp8 | Meta | — | — | — | — | $0.15 | $0.29 | 32K |
| Glm-5.3-Flash zai-org/glm-5.3-flash | Zai-org | — | — | — | — | $0.15 | $0.50 | 1.0M |
| Llama-3.2-1b-Instruct meta/llama-3.2-1b-instruct | Meta | — | — | — | — | $0.027 | $0.20 | 60K |
| Clef cloudflare/clef | AIgateway | — | — | — | — | $0.24 | free | 66K |
| Glm-4.7-Flash zai-org/glm-4.7-flash | Zai-org | — | — | — | — | $0.060 | $0.40 | 131K |
| Llama-2-7b-Chat-HF-Lora meta-llama/llama-2-7b-chat-hf-lora | Meta-llama | — | — | — | — | $0.040 | $0.080 | 8K |
| Llama-3.3-70b-Instruct-Fp8-Fast meta/llama-3.3-70b-instruct-fp8-fast | Meta | — | — | — | — | $0.29 | $2.25 | 24K |
| Granite-4.0-H-Micro ibm-granite/granite-4.0-h-micro | Ibm-granite | — | — | — | — | $0.017 | $0.11 | 131K |
| Deepseek-V4-Flash-0731 deepseek/deepseek-v4-flash-0731 | Deepseek | — | — | — | — | $0.44 | $1.32 | 1.0M |
| Apertus-V1.5-8b swiss-ai/apertus-v1.5-8b | Swiss-ai | — | — | — | — | $0.10 | $0.20 | 262K |
| Clef-Omni cloudflare/clef-omni | AIgateway | — | — | — | — | $0.15 | free | 66K |
| Qwen2.5-Coder-32b-Instruct qwen/qwen2.5-coder-32b-instruct | Alibaba Qwen | — | — | — | — | $0.66 | $1.00 | 33K |
| GLM-5.2 zai-org/glm-5.2 | Zai-org | — | — | — | — | $1.40 | $4.40 | 262K |
| Gemma-Sea-Lion-V4-27b-IT aisingapore/gemma-sea-lion-v4-27b-it | AI Singapore | — | — | — | — | $0.35 | $0.56 | 128K |
| Qwen3-30b-A3b-Fp8 qwen/qwen3-30b-a3b-fp8 | Alibaba Qwen | — | — | — | — | $0.051 | $0.34 | 33K |
| Gemma-7b-IT-Lora google/gemma-7b-it-lora | — | — | — | — | $0.080 | $0.16 | 4K | |
| Gemma-4-26b-A4b-IT google/gemma-4-26b-a4b-it | — | — | — | — | $0.10 | $0.30 | 256K | |
| Mistral-Small-3.1-24b-Instruct mistralai/mistral-small-3.1-24b-instruct | Mistral | — | — | — | — | $0.35 | $0.55 | 128K |
| Deepseek-V4-Pro-0813 deepseek/deepseek-v4-pro-0813 | Deepseek | — | — | — | — | $1.32 | $3.96 | 1.0M |
| Gpt-Oss-20b openai/gpt-oss-20b | OpenAI | — | — | — | — | $0.20 | $0.30 | 128K |
| Llama-4-Scout-17b-16e-Instruct meta/llama-4-scout-17b-16e-instruct | Meta | — | — | — | — | $0.27 | $0.85 | 131K |
| Clef-Flash cloudflare/clef-flash | AIgateway | — | — | — | — | $0.038 | free | 25K |
| Claude Fable 5 anthropic/claude-fable-5 | Anthropic | — | — | — | — | $10.00 | $50.00 | 1M |
| Claude Fable 5.1 anthropic/claude-fable-5.1 | Anthropic | — | — | — | — | $10.00 | $50.00 | 1M |
| Claude Haiku 4.5 anthropic/claude-haiku-4.5 | Anthropic | — | 80.1 | — | 85.2 | $1.00 | $5.00 | 200K |
| Claude Haiku 5.5 anthropic/claude-haiku-5.5 | Anthropic | — | — | — | — | $0.10 | $0.50 | 1M |
| Claude Opus 4.5 anthropic/claude-opus-4.5 | Anthropic | — | — | — | — | $5.00 | $25.00 | 200K |
| Claude Opus 4.6 anthropic/claude-opus-4.6 | Anthropic | — | — | — | — | $5.00 | $25.00 | 1M |
| Claude Opus 4.7 anthropic/claude-opus-4.7 | Anthropic | 72.5 | 90.4 | — | 95.1 | $5.00 | $25.00 | 1M |
| Claude Opus 4.8 anthropic/claude-opus-4.8 | Anthropic | — | — | — | — | $5.00 | $25.00 | 1M |
| Claude Opus 5 anthropic/claude-opus-5 | Anthropic | — | — | — | — | $5.00 | $25.00 | 1M |
| Claude Sonnet 4.5 anthropic/claude-sonnet-4.5 | Anthropic | — | — | — | — | $3.00 | $15.00 | 200K |
| Claude Sonnet 4.6 anthropic/claude-sonnet-4.6 | Anthropic | 62.1 | 87.2 | — | 93.4 | $3.00 | $15.00 | 200K |
| Claude Sonnet 5 anthropic/claude-sonnet-5 | Anthropic | — | — | — | — | $2.00 | $10.00 | 1M |
| DeepSeek-V4-Pro deepseek/deepseek-v4-pro | Deepseek | — | — | — | — | $2.40 | $4.80 | 1M |
| GPT-4.1 openai/gpt-4.1 | OpenAI | — | — | — | — | $2.00 | $8.00 | 1.0M |
| GPT-4.1 Mini openai/gpt-4.1-mini | OpenAI | — | — | — | — | $0.40 | $1.60 | 1.0M |
| GPT-4.1 Nano openai/gpt-4.1-nano | OpenAI | — | — | — | — | $0.10 | $0.40 | 1M |
| GPT-4o openai/gpt-4o | OpenAI | — | — | — | — | $1.25 | $5.00 | 128K |
| GPT-4o Mini openai/gpt-4o-mini | OpenAI | — | — | — | — | $0.075 | $0.30 | 128K |
| GPT-5 openai/gpt-5 | OpenAI | — | — | — | — | $1.25 | $10.00 | 128K |
| GPT-5 Mini openai/gpt-5-mini | OpenAI | — | — | — | — | $0.25 | $2.00 | 128K |
| GPT-5 Nano openai/gpt-5-nano | OpenAI | — | — | — | — | $0.050 | $0.40 | 128K |
| GPT-5.1 openai/gpt-5.1 | OpenAI | — | — | — | — | $1.25 | $10.00 | 128K |
| GPT-5.4 openai/gpt-5.4 | OpenAI | — | 91.8 | — | 94.0 | $2.50 | $15.00 | 1M |
| GPT-5.4 Mini openai/gpt-5.4-mini | OpenAI | — | 84.5 | — | 88.6 | $0.75 | $4.50 | 128K |
| GPT-5.4 Nano openai/gpt-5.4-nano | OpenAI | — | — | — | — | $0.20 | $1.25 | 128K |
| GPT-5.4 Pro openai/gpt-5.4-pro | OpenAI | — | — | — | — | $30.00 | $180.00 | 1M |
| GPT-5.5 openai/gpt-5.5 | OpenAI | — | — | — | — | $5.00 | $30.00 | 1M |
| GPT-5.6 Luna openai/gpt-5.6-luna | OpenAI | — | — | — | — | $0.20 | $1.20 | 1.1M |
| GPT-5.6 Terra openai/gpt-5.6-terra | OpenAI | — | — | — | — | $2.00 | $12.00 | 1.1M |
| GPT-6 Astra openai/gpt-6-astra | OpenAI | — | — | — | — | $10.00 | $50.00 | 1.1M |
| GPT-6 Luna openai/gpt-6-luna | OpenAI | — | — | — | — | $0.10 | $0.50 | 1.1M |
| GPT-6 Sol openai/gpt-6-sol | OpenAI | — | — | — | — | $2.00 | $10.00 | 1.1M |
| Gemini 2.5 Flash Lite google/gemini-2.5-flash-lite | — | — | — | — | $0.10 | $0.40 | 1M | |
| Gemini 3 Flash google/gemini-3-flash | — | 82.3 | — | — | $0.50 | $3.00 | 1M | |
| Gemini 3.1 Flash Lite google/gemini-3.1-flash-lite | — | — | — | — | $0.25 | $1.50 | 1M | |
| Gemini 3.5 Flash google/gemini-3.5-flash | — | — | — | — | $1.50 | $9.00 | 1.0M | |
| Gemini 3.5 Flash-Lite google/gemini-3.5-flash-lite | — | — | — | — | $0.30 | $2.50 | 1.0M | |
| Gemini 3.6 Flash google/gemini-3.6-flash | — | — | — | — | $1.50 | $7.50 | 1.0M | |
| Gemini 3.7 Flash google/gemini-3.7-flash | — | — | — | — | $0.75 | $3.75 | 1.0M | |
| Gemini 3.8 Flash google/gemini-3.8-flash | — | — | — | — | $0.75 | $3.75 | 1.0M | |
| Grok 4.20 Non-Reasoning xai/grok-4.20-0309-non-reasoning | xAI | — | — | — | — | $2.00 | $6.00 | 2M |
| Grok 4.20 Reasoning xai/grok-4.20-0309-reasoning | xAI | — | — | — | — | $2.00 | $6.00 | 2M |
| Grok 4.3 xai/grok-4.3 | xAI | — | — | — | — | $1.25 | $2.50 | 1M |
| Grok 4.5 xai/grok-4.5 | xAI | — | — | — | — | $2.00 | $6.00 | 500K |
| Grok 4.6 xai/grok-4.6 | xAI | — | — | — | — | $2.00 | $6.00 | 500K |
| MiniMax M2.7 minimax/m2.7 | MiniMax | — | — | — | — | $0.30 | $1.20 | 128K |
| Qwen3.5-397B-A17B alibaba/qwen3.5-397b-a17b | Alibaba | — | — | — | — | $0.60 | $3.60 | 262K |
| Qwen3.7-Max alibaba/qwen3.7-max | Alibaba | — | — | — | — | $2.50 | $7.50 | 1M |
| Qwen3.7-Plus alibaba/qwen3.7-plus | Alibaba | — | — | — | — | $0.40 | $1.60 | 1M |
| O3-Mini openai/o3-mini | OpenAI | — | — | — | — | $1.10 | $4.40 | 200K |
| O4-Mini openai/o4-mini | OpenAI | — | — | — | — | $1.10 | $4.40 | 200K |
| Qwen-Flash alibaba/qwen-flash | Alibaba | — | — | — | — | $0.050 | $0.40 | 1M |
| Qwen-Flash-Character alibaba/qwen-flash-character | Alibaba | — | — | — | — | $0.050 | $0.40 | 8K |
| Qwen-Max alibaba/qwen-max | Alibaba | — | — | — | — | $1.60 | $6.40 | 33K |
| Qwen-Plus alibaba/qwen-plus | Alibaba | — | — | — | — | $0.40 | $4.00 | 1M |
| Qwen-Plus-Character alibaba/qwen-plus-character | Alibaba | — | — | — | — | $0.50 | $1.40 | 33K |
| Qwen-Plus-Character-Japanese alibaba/qwen-plus-character-ja | Alibaba | — | — | — | — | $0.50 | $1.40 | 8K |
| Qwen-Plus-Latest alibaba/qwen-plus-latest | Alibaba | — | — | — | — | $0.40 | $4.00 | 1M |
| QwenVL-OCR alibaba/qwen-vl-ocr | Alibaba | — | — | — | — | $0.070 | $0.16 | 38K |
| Qwen3-Coder-Flash alibaba/qwen3-coder-flash | Alibaba | — | — | — | — | $0.30 | $1.50 | 1M |
| Qwen3-VL-Plus alibaba/qwen3-vl-plus | Alibaba | — | — | — | — | $0.20 | $1.60 | 262K |
| Qwen3.5-122B-A10B alibaba/qwen3.5-122b-a10b | Alibaba | — | — | — | — | $0.40 | $3.20 | 262K |
| Qwen3.5-27B alibaba/qwen3.5-27b | Alibaba | — | — | — | — | $0.30 | $2.40 | 262K |
| Qwen3.5-35B-A3B alibaba/qwen3.5-35b-a3b | Alibaba | — | — | — | — | $0.25 | $2.00 | 262K |
| Qwen3.5-Flash alibaba/qwen3.5-flash | Alibaba | — | — | — | — | $0.10 | $0.40 | 1M |
| Qwen3.5-Plus alibaba/qwen3.5-plus | Alibaba | — | — | — | — | $0.40 | $2.40 | 1M |
| Qwen3.6-27B alibaba/qwen3.6-27b | Alibaba | — | — | — | — | $0.60 | $3.60 | 262K |
| Qwen3.6-35B-A3B alibaba/qwen3.6-35b-a3b | Alibaba | — | — | — | — | $0.38 | $2.25 | 262K |
| Qwen3.6-Flash alibaba/qwen3.6-flash | Alibaba | — | — | — | — | $0.25 | $1.50 | 1M |
| Qwen3.6-Plus alibaba/qwen3.6-plus | Alibaba | — | — | — | — | $0.50 | $3.00 | 1M |
| Qwen3.7-Flash alibaba/qwen3.7-flash | Alibaba | — | — | — | — | $0.030 | $0.13 | 1M |
| Qwen3.7-Max-Preview alibaba/qwen3.7-max-preview | Alibaba | — | — | — | — | $2.50 | $7.50 | 1M |
| Qwen3.8-2.4T-A95B alibaba/qwen3.8-2.4t-a95b | Alibaba | — | — | — | — | $2.00 | $6.00 | 1M |
| Qwen3.8-Flash alibaba/qwen3.8-flash | Alibaba | — | — | — | — | $0.15 | $0.47 | 1M |
| Qwen3.8-Omni-Flash alibaba/qwen3.8-omni-flash | Alibaba | — | — | — | — | $0.15 | $0.47 | 1M |
| DeepSeek-V4.1-Flash deepseek/deepseek-v4.1-flash | DeepSeek | — | — | — | — | $0.30 | $1.20 | 1M |
| GLM-5.1 zai-org/glm-5.1 | Z.ai | — | — | — | — | $1.40 | $4.40 | 203K |
| GLM-5.2-Fast-Preview zai-org/glm-5.2-fast-preview | Z.ai | — | — | — | — | $2.80 | $8.80 | 1M |
| IndicTrans2 EN→Indic 1B ai4bharat/indictrans2-en-indic-1B | AI4Bharat | — | — | — | — | $0.021 | $0.042 | — |
| DistilBERT SST-2 huggingface/distilbert-sst-2-int8 | Hugging Face | — | — | — | — | — | — | — |
| M2M100 1.2B meta/m2m100-1.2b | Meta | — | — | — | — | $0.021 | $0.042 | — |
Five opinionated slices: coding agents, reasoning-heavy work, cheapest model with tool calling, longest context, and fastest text models. Each slice cites the underlying benchmark or pricing field directly.
| Model | Provider | SWE-bench |
|---|---|---|
| Claude Opus 4.7 anthropic/claude-opus-4.7 | Anthropic | 72.5 |
| Kimi-K2.6 moonshot/kimi-k2.6 | Moonshot | 68.2 |
| Claude Sonnet 4.6 anthropic/claude-sonnet-4.6 | Anthropic | 62.1 |
| Model | Provider | Score |
|---|---|---|
| GPT-5.4 openai/gpt-5.4 | OpenAI | 91.8 MMLU |
| Claude Opus 4.7 anthropic/claude-opus-4.7 | Anthropic | 90.4 MMLU |
| Gemini 3.1 Pro google/gemini-3.1-pro | 89.6 MMLU | |
| Claude Sonnet 4.6 anthropic/claude-sonnet-4.6 | Anthropic | 87.2 MMLU |
| GPT-5.4 Mini openai/gpt-5.4-mini | OpenAI | 84.5 MMLU |
| Gemini 3 Flash google/gemini-3-flash | 82.3 MMLU | |
| Claude Haiku 4.5 anthropic/claude-haiku-4.5 | Anthropic | 80.1 MMLU |
| Model | Provider | In + Out /M |
|---|---|---|
| Granite-4.0-H-Micro ibm-granite/granite-4.0-h-micro | Ibm-granite | $0.13 |
| Qwen3.7-Flash alibaba/qwen3.7-flash | Alibaba | $0.16 |
| Eurollm-9b-IT utter-project/eurollm-9b-it | Utter-project | $0.30 |
| Apertus-V1.5-8b swiss-ai/apertus-v1.5-8b | Swiss-ai | $0.30 |
| Qwen3-30b-A3b-Fp8 qwen/qwen3-30b-a3b-fp8 | Alibaba Qwen | $0.39 |
| Gemma-4-26b-A4b-IT google/gemma-4-26b-a4b-it | $0.40 | |
| GPT-5 Nano openai/gpt-5-nano | OpenAI | $0.45 |
| Qwen-Flash alibaba/qwen-flash | Alibaba | $0.45 |
| Model | Provider | Context |
|---|---|---|
| Grok 4.20 Non-Reasoning xai/grok-4.20-0309-non-reasoning | xAI | 2M |
| Grok 4.20 Reasoning xai/grok-4.20-0309-reasoning | xAI | 2M |
| GPT-5.6 Luna openai/gpt-5.6-luna | OpenAI | 1.1M |
| GPT-5.6 Sol openai/gpt-5.6-sol | OpenAI | 1.1M |
| GPT-5.6 Terra openai/gpt-5.6-terra | OpenAI | 1.1M |
| GPT-6 Astra openai/gpt-6-astra | OpenAI | 1.1M |
| GPT-6 Luna openai/gpt-6-luna | OpenAI | 1.1M |
| GPT-6 Sol openai/gpt-6-sol | OpenAI | 1.1M |
| Model | Provider | Tier |
|---|---|---|
| Llama-3.3-70b-Instruct-Fp8-Fast meta/llama-3.3-70b-instruct-fp8-fast | Meta | edge |
| Llama-4-Scout-17b-16e-Instruct meta/llama-4-scout-17b-16e-instruct | Meta | edge |
| Claude Haiku 4.5 anthropic/claude-haiku-4.5 | Anthropic | edge |
| Claude Haiku 5.5 anthropic/claude-haiku-5.5 | Anthropic | edge |
| GPT-4.1 Mini openai/gpt-4.1-mini | OpenAI | edge |
| GPT-4.1 Nano openai/gpt-4.1-nano | OpenAI | edge |
| GPT-4o Mini openai/gpt-4o-mini | OpenAI | edge |
| GPT-5 Mini openai/gpt-5-mini | OpenAI | edge |
Benchmarks: sourced from each lab's published eval card (Anthropic system cards, OpenAI release notes, Google's technical reports, Moonshot's Kimi paper, Meta's Llama reports). Missing cells mean the lab hasn't disclosed that benchmark — not that the model failed it.
Pricing: the exact pass-through rate you pay on AIgateway. The $/M tokens here is what the provider charges — nothing added.
Updates: the catalog updates on every release, so this page moves when a new frontier model lands. The JSON endpoint is at GET /api/leaderboard with a one-hour browser cache — embed it on your own comparison post.
Want to run any of these? Every row links to a model page with quickstart code. Or try the cost calculator to project spend across candidate models for your workload.