Skip to content
Evaluation sources

LiveBench · Reasoning and mathematics

LiveBench / Reasoning · An equal-weight average of Reasoning and Mathematics, at 50% each.

Official evaluation
Across NexGateHub AI News Ranked
Evidence budget4.2%
Upstream data time10/13 06:59
Last successful sync10/18 14:05

What it measures and how

Reasoning and Mathematics are calculated separately, averaged at 50% each, and rounded to one decimal. This differs from selecting either category alone on the official site.

How this evidence is used

The average contributes one item of ranking evidence. Specialist tasks share a LiveBench evidence family. Global Average is reference only and is not counted again.

Evaluation results

Fixed rules select one representative configuration per public model. Anonymous test models are omitted. Original ranks are retained, with up to 30 models per evaluation.

Source rankSource model nameRaw resultRepresentative configuration
1gpt-6.1-sol-maxopenai94.7%Max reasoning
2gpt-6-astra-maxOpenAI94.7%Max reasoning
3claude-opus-5-5-max-effortAnthropic94.6%Max reasoning
4claude-fable-5-1-max-effortAnthropic94.3%Max reasoning
6gpt-5.6-sol-maxOpenAI93.9%Max reasoning
7claude-sonnet-5-5-max-effortanthropic93.9%Max reasoning
9muse-wonder-1.0-max—93.6%Max reasoning
10claude-opus-5-max-effortAnthropic93.5%Max reasoning
11claude-fable-5-max-effortAnthropic92.8%Max reasoning
12muse-spark-1.3-xhighMeta92.8%xHigh reasoning
13gpt-5.6-terra-maxOpenAI92.8%Max reasoning
14gpt-5.5-xhighOpenAI92.8%xHigh reasoning
15gpt-6-sol-maxOpenAI92.5%Max reasoning
16claude-opus-4-8-max-effortAnthropic91.8%Max reasoning
18grok-4.6xAI91.5%Source default
19gpt-5.4-xhighOpenAI91.1%xHigh reasoning
20claude-sonnet-5-xhigh-effortAnthropic90.8%xHigh reasoning
21gemini-3.7-flash-highGoogle90.6%High reasoning
22muse-spark-1.2-xhighMeta90.6%xHigh reasoning
23deepseek-v4-pro-0813DeepSeek90.5%Source default
24gemini-3.8-flash-highGoogle90.4%High reasoning
25claude-opus-4-7-xhigh-effortAnthropic90.0%xHigh reasoning
26deepseek-v4.1-flash-maxDeepSeek90.0%Source default
27qwen3.8-maxAlibaba89.8%Source default
28grok-4.7-xhighxAI89.2%xHigh reasoning
29grok-4.5xAI89.0%Source default
30claude-opus-4-6-thinking-auto-high-effortAnthropic89.0%High reasoning
31mistral-large-4-high—88.8%Source default
32gpt-5.2-2025-12-11-highOpenAI88.2%High reasoning
33smaug-flashAbacus.AI88.1%Source default
Evaluation limits & attribution

This average measures combined performance, not Reasoning alone. Official category and fine-tuned-model filters change scores and ranks. Organizer Abacus.AI also develops Smaug; exclusive results need independent corroboration.

Data license: Apache 2.0

LiveBench publishes the components. AIHOT averages the two categories equally and ranks them. This average and the AIHOT consensus index use different scales and cannot be added directly.