Coding
One task: one bug fix in a real codebase: about 100,000 tokens read (files, history, tool output) and 10,000 written. 21 models with API prices, 3 local.
- Best-value line: nothing else is both cheaper and higher scoring
- Other models with API prices
- Local: free to run, needs your own hardware
Hover over or tap a dot to see the model, its score and its cost.
Show as a table
| Model | Octopus Score | Cost per task | Data |
|---|---|---|---|
| Claude Opus 5.5 Anthropic | 99 | $0.60 | All benchmarks |
| Claude Sonnet 5.5 Anthropic | 93 | $0.30 | All benchmarks |
| GPT-6 Astra OpenAI | 93 | $1.50 | Partial (4 of 5 benchmarks) |
| GPT-6.1 Sol OpenAI | 89 | $0.30 | Partial (3 of 5 benchmarks) |
| Claude Fable 5.1 Anthropic | 88 | $1.50 | All benchmarks |
| Gemini 4 Argon Google | 85 | $0.30 | Partial (4 of 5 benchmarks) |
| Muse Wonder Meta | 81 | $0.60 | Partial (3 of 5 benchmarks) |
| DeepSeek V4.1 Flash DeepSeek | 76 | $0.042 | Partial (2 of 5 benchmarks) |
| Kimi K3 Moonshot AI | 67 | $0.45 | Partial (3 of 5 benchmarks) |
| GLM-5.3 Z.ai | 66 | $0.184 | All benchmarks |
| Claude Haiku 5.5 Anthropic | 65 | $0.015 | Partial (3 of 5 benchmarks) |
| Qwen3.8 27B Qwen (Alibaba) | 64 | Local | Partial (2 of 5 benchmarks) |
| DeepSeek V4 Pro DeepSeek | 64 | $0.172 | Partial (2 of 5 benchmarks) |
| GPT-5.6 Terra OpenAI | 62 | $0.32 | Partial (3 of 5 benchmarks) |
| Grok 4.7 xAI | 60 | $0.26 | Partial (4 of 5 benchmarks) |
| GLM-5.3 Flash Z.ai | 58 | $0.02 | All benchmarks |
| Muse Spark 1.3 Meta | 57 | $0.168 | All benchmarks |
| Qwen3.8 Max Qwen (Alibaba) | 56 | $0.26 | Partial (4 of 5 benchmarks) |
| Gemini 3.8 Flash Google | 53 | $0.113 | All benchmarks |
| Gemma 4 31B Google | 49 | Local | Partial (2 of 5 benchmarks) |
| Gemma 4 26B A4B Google | 46 | Local | Partial (2 of 5 benchmarks) |
| Mistral Medium 3.5 Mistral | 43 | $0.225 | Partial (2 of 5 benchmarks) |
| Mistral Large 3 Mistral | 41 | $0.065 | Partial (2 of 5 benchmarks) |
| GPT-6 Luna OpenAI | 33 | $0.015 | Partial (2 of 5 benchmarks) |