τ-bench (tau2-bench) — USASI news https://unitedstatesofamericasuperintelligence.com/open/tau-bench/ Dated, sourced news items in the USASI catalog that mention τ-bench (tau2-bench). Independent project. Not a United States government website. en-us Wed, 21 Oct 2026 12:00:00 GMT Sierra releases τ-bench 2.0.0 with six language packs and frozen voice and text benchmarks https://unitedstatesofamericasuperintelligence.com/news/tau-bench-2-0-0-released/ https://unitedstatesofamericasuperintelligence.com/news/tau-bench-2-0-0-released/ Wed, 21 Oct 2026 12:00:00 GMT release Sierra's τ-bench repository published τ-bench 2.0.0, which its release notes date October 19, 2026 and title "Multilingual and Voice". The notes say a --language option now selects one of six language packs (English, Spanish, Portuguese, Hindi, Chinese and Korean) with localized databases, tasks and caller personas for the airline, retail and telecom domains, and that frozen, pinned benchmark manifests such as voice-v2 and text-v1 replace ad-hoc task selection. The release also adds an intake domain for entity capture, a post-hoc tau2 judges suite that the notes say is diagnostic only, and 2.0 leaderboard submission packages. The notes state that 2.0 results are not comparable with 1.x results and point to the v1.0.1 tag for comparable runs. USASI has not tested this release. Sierra open-sources Hyper-τ-bench, an evaluation of models that build customer-service agents https://unitedstatesofamericasuperintelligence.com/news/sierra-open-sources-hyper-tau-bench/ https://unitedstatesofamericasuperintelligence.com/news/sierra-open-sources-hyper-tau-bench/ Tue, 13 Oct 2026 12:00:00 GMT research On September 8, 2026 Sierra published Hyper-τ-bench, a long-horizon evaluation that measures whether a model can build a customer-service agent rather than only act as one. A developer agent works in a sandboxed workspace with a simulated business's records and a simulated client it can message, must recover the requirements and turn the business's actions into tools, and the finished agent is then tested on held-out tasks the developer never saw. Sierra says it is open-sourcing the benchmark, with code in the sierra-research/hyper-tau-bench repository, a public leaderboard, and a paper on arXiv; the post does not state a license. USASI has not run the benchmark.