Evaluations Show Multi-Agent Teams Cost More but Deliver Limited Quality Gains
Understand the story
On October 11, 2026, The Decoder reported that research firm Vals AI tested GPT-6 Sol and Claude Opus 5.5 on the Vibe Code Bench in both single-agent and multi-agent team modes. Results showed that multi-agent team mode cost 1.8 to 5.1 times as much as a single agent and consumed large amounts of tokens, while delivering minimal quality gains: across four comparisons, only GPT-6 Sol at the medium reasoning level scored 7.3 points higher than the single agent, with a statistically significant improvement; no other combination showed significant quality gains. The evaluation suggests that, at current model levels, the cost-effectiveness of teaming up multiple AI agents is questionable.
AI overview of reporting · Updated 7 days ago
Reporting timeline
Explore different aspects of the story through its reporting.
- The DecoderAI agent teams waste massive tokens for barely measurable quality gains, research finds
Vals AI tested GPT-6 Sol and Claude Opus 5.5 in single-agent versus team setups on Vibe Code Bench, finding teams cost 1.8x to 5.1x as much as single agents, and of four comparisons only GPT-6 Sol at the medium reasoning tier improved 7.3 points with statistical significance.
Story heat trend
Current heat3·Comparable peak10（10/12 01:00）·Comparable change over 24 hours -51%
The trend compares the same continuously observed sources, which may cover fewer sources than the current heat score. Hover or select the chart to inspect each hour; use the left and right arrow keys to navigate.