Vending-Bench 2
Andon Labs / Professional work · Runs a simulated shop for a year, managing purchasing, negotiation, inventory, and pricing.
What it measures and how
Compares final balances on the same V2 single-agent task, retaining repeated-run variance. Competitive Arena, tools, and tiers remain separate. Business outcomes are task scores; API prices do not affect ability.
How this evidence is used
Under review: long-term business and ecommerce evidence could be valuable. Stable results, configurations, and redisplay permission are needed. Profits may exploit the simulator and do not establish trustworthy business conduct.
Evaluation limits & attribution
Under review: long-term business and ecommerce evidence could be valuable. Stable results, configurations, and redisplay permission are needed. Profits may exploit the simulator and do not establish trustworthy business conduct.
Data license: Leaderboard-data usage terms need confirmation.
Results are published by Andon Labs. Original scores and the NexGateHub consensus index use different scales and cannot be added directly.