Terminal-Bench 4 · System reference
Harbor / Terminal-Bench / Coding · Retains original terminal-task results for models paired with different agents as cross-references.
What it measures and how
Fixes Terminal-Bench 4.0, retaining model, agent version, reasoning tier, and run count separately. Different tool systems are not interpreted as common model conditions.
How this evidence is used
Reference results: collected automatically after official submission lists and versions are fixed. Every system configuration is retained without selecting one model score. Cross-reference only; excluded from overall and coding rankings.
Evaluation results
These system results pair models with different agents under different run conditions and are reference only. Up to 30 configurations are displayed per evaluation. Anonymous test models are omitted.
| Source rank | Source model name | Raw result | Run configuration |
|---|---|---|---|
| 1 | claude-opus-5-5Anthropic | 64.8% | Claude Code 2.1.284 · max reasoning |
| 2 | claude-sonnet-5-5anthropic | 61.8% | Claude Code 2.1.284 · max reasoning |
| 3 | gpt-6.1-solopenai | 58.2% | Codex 0.159.0 · max reasoning |
| 4 | claude-fable-5-1Anthropic | 57.9% | Claude Code 2.1.257 · max reasoning |
| 5 | claude-opus-5Anthropic | 51.8% | Claude Code 2.1.231 · max reasoning |
| 6 | gpt-6-solOpenAI | 49.4% | Codex 0.159.0 · max reasoning |
| 7 | claude-fable-5Anthropic | 44.5% | Claude Code 2.1.231 · max reasoning |
| 8 | glm-5.3Z.ai | 41.8% | Claude Code 2.1.207 · max reasoning |
| 9 | gpt-5.6-solOpenAI | 37.3% | Codex 0.149.1 · max reasoning |
| 10 | glm-5.3-flashZ.ai | 35.8% | Claude Code 2.1.285 · Reasoning tier not reported |
| 11 | qwen3.8-max-0902Alibaba | 27.0% | Claude Code 2.1.285 · max reasoning |
| 12 | claude-opus-4-8Anthropic | 23.6% | Claude Code 2.1.231 · max reasoning |
| 13 | gpt-5.6-terraOpenAI | 21.5% | Codex 0.149.1 · max reasoning |
| 14 | grok-4.6xAI | 20.3% | Grok Build 1.0.5 · Reasoning tier not reported |
| 15 | gemini-3.8-flashGoogle | 19.1% | mini-SWE-agent 2.4.6 · high reasoning |
| 16 | gpt-5.6-lunaOpenAI | 17.3% | Codex 0.149.1 · max reasoning |
| 17 | gpt-6-lunaOpenAI | 16.4% | Codex 0.159.0 · max reasoning |
| 18 | muse-spark-1.3Meta | 14.6% | Muse Code 1.4.1 · xhigh reasoning |
| 19 | claude-sonnet-5Anthropic | 12.4% | Claude Code 2.1.231 · max reasoning |
| 19 | grok-4.5xAI | 12.4% | Grok Build 1.0.5 · Reasoning tier not reported |
| 21 | gemini-3.7-flashGoogle | 11.2% | mini-SWE-agent 2.4.6 · high reasoning |
Evaluation limits & attribution
Models use different tools including Claude Code, Codex, GrokBuild, and mini-SWE. AA v4.3 already includes Terminal-Bench v4, so it receives no additional overall weight.
Data license: Apache 2.0 · Official submissions in harbor-framework/terminal-bench. Retain attribution, protocol, and modification notices.
Results are published by Harbor / Terminal-Bench. Original scores and the NexGateHub consensus index use different scales and cannot be added directly.