Skip to content
Evaluation sources

τ³-Banking

Sierra / Professional work · Handles banking in a common tool environment to assess rules, customer communication, and completion.

Official evaluation
Across NexGateHub AI News Awaiting results
Evidence budget2%
Upstream data timeUnverified
Last successful syncAwaiting comparable results

What it measures and how

Only official standard banking, v1.0.1, alltools, and GPT-5.2 user simulation are compared using pass@1. Different tools, prompts, simulators, voice modes, and custom systems stay separate.

How this evidence is used

Ranked: receives 2% of the tools-and-office budget. Mercor APEX's two shared environments receive 4% total. Finance does not establish coverage of law, ecommerce, or every industry.

Evaluation limits & attribution

Results belong to a fixed banking system and depend on simulated users and tool protocols. They are not universal professional accuracy.

Data license: MIT · Official Sierra Research tau2-bench repository. Retain source attribution.

Results are published by Sierra. Original scores and the NexGateHub consensus index use different scales and cannot be added directly.