OpenRouter ships Model Router Benchmarks: 7 routers vs 6 suites on quality, speed, and cost
On 2 Oct 2026 OpenRouter shipped Model Router Benchmarks: seven model routers (Auto, Jev, NVIDIA Switchyard, Unbiased Pareto, Sakana Fugu, and variants) compared on GPQA Diamond, Tau3 Banking, MMMU Pro Vision, SWE Atlas QA, Deep SWE, and Terminal Bench 2.1. The Router Index defaults to quality 60% / time 20% / cost 20%. openrouter/pareto-code and Fusion are not on this board.
Key Takeaways
- Announced 2026-10-02 22:08 UTC; blog by Brian Thomas dated 10/2/2026; live page openrouter.ai/benchmarks/routers
- Seven router slugs in the public stats feed: openrouter/auto, typesafe/jev-router, nvidia/switchyard, unbiased/pareto, sakana/fugu-max, sakana/fugu-ultra, sakana/fugu-ultra-v2. pareto-code and Fusion were not benchmarked
- Router Index default is quality 60% / time 20% / cost 20% on a 0-10 scale; it is not raw accuracy
- Stats API 2026-10-04 SGT, Deep SWE n=113: Switchyard Flash+Opus 5.5 and Opus-only both 83/113 (~$279 / $285); Flash+GPT-6 Sol 74/113 at ~$55
- Terminal Bench 2.1 n=89: GPT-6 Astra 77/89 ($66.50), Opus 5.5 74/89 ($24.00); one Pareto run 71/89 ($27.20)
Linked Models & Agents:
⚡ openrouter/auto⚡ typesafe/jev-router⚡ nvidia/switchyard⚡ unbiased/pareto⚡ sakana/fugu-ultra-v2⚡ openrouter/pareto-code🌐 OpenRouter🌐 NVIDIA🌐 Sakana🌐 TypeSafe🌐 Unbiased