Independent evaluator Artificial Analysis published two new results on November 10. On AA-3D, which tests how well a model acting as an agent builds interactive three.js web scenes, Claude Fable 5.2 (Max) scores 1271 Elo, 67 points ahead of second-place Claude Sonnet 5.5 (1204); its 95% confidence interval of 1246 to 1297 does not overlap any other model, so the lead is outside the margin of error. It is 132 points above Fable 5.1 (1139) and ahead of the top OpenAI and Google entries, GPT-6 Astra (1168) and Gemini 4 Argon (1147). On VIALS-AA, a life-science image reasoning benchmark, Fable 5.2 scores 67%, ahead of previous leader Gemini 4 Carbon (64%) and GPT-6 Astra (63%). AA also found opposite strategies: Fable averages about 37 tool calls per task, Astra about 8.
Key Takeaways
- ✓AA-3D: Fable 5.2 (Max) 1271 Elo vs Sonnet 5.5 1204 and Opus 5.5 1202; its 95% CI of 1246-1297 overlaps no other model
- ✓Generational gain: 132 points above Fable 5.1 (1139); the top OpenAI entry GPT-6 Astra scores 1168, the top Google entry Gemini 4 Argon 1147
- ✓AA-3D setup: each model works as an agent in an offline sandbox for up to 3 hours / 250 turns with Blender, Rapier physics, Python and a headless browser; human panelists vote on blind pairs after at least 30 seconds per scene
- ✓VIALS-AA: Fable 5.2 67%, Gemini 4 Carbon 64%, GPT-6 Astra 63%
- ✓Opposite tool strategies: Fable makes about 37 tool calls per task and 1.60 per turn (highest on the board); Astra makes about 8, the fewest AA has measured
Key Decision Metrics at a Glance
Turn your technical choice into a development budget
Compare 40 dev plans & simulate token costs vs $20/mo subscriptions
Project Links & Resources
Direct AccessIn-Depth Technical Analysis
Background and Pain Points
After Claude Fable 5.2 launched, the key question was whether Anthropic's own numbers would hold up under third-party testing. Standard Q&A and coding leaderboards rarely separate frontier models anymore. Developers want to know whether a model can build a complete, good-looking interactive artifact on its own, and whether it can reason reliably about scientific images. Artificial Analysis's AA-3D and VIALS-AA target exactly these two needs, and both are independent evaluations rather than vendor claims.
Architecture Highlights
AA-3D runs each model as an agent in an offline sandbox. Given a written brief, such as an animated Starship mission from launch through booster catch to ship landing, it builds a three.js web page within 3 hours and 250 turns, using Blender, the Rapier physics engine, Python and a headless browser to test its own work. Human panelists vote on blind pairs built from the same brief, spending at least 30 seconds with each scene, and votes become Elo ratings. VIALS-AA is AA's implementation of Handshake AI's VIALS benchmark, covering life-science images such as gel blots, plasmid maps and phylogenies.
Benchmarks
AA-3D: Fable 5.2 (Max) 1271 Elo, Sonnet 5.5 1204, Opus 5.5 1202, GPT-6 Astra 1168, Gemini 4 Argon 1147, Fable 5.1 1139. Fable 5.2's 95% confidence interval of 1246 to 1297 overlaps no other model. VIALS-AA: Fable 5.2 scores 67%, ahead of previous leader Gemini 4 Carbon (64%) and GPT-6 Astra (63%). Fable averages about 37 tool calls per task, mostly cropping and viewing images, while Astra averages about 8. Stronger Anthropic models call more tools; stronger OpenAI models call fewer. All figures are AA's independent results.
Getting Started
For 3D web pages, visualizations and game prototypes, Fable 5.2 now leads the third-party board, but AA-3D used the Max setting, which is slow and costly at $8/$40 per million tokens, so try lower effort first. For scientific or inspection tasks that require reading images, give it image cropping and code execution tools and it will check its work over many steps; if call count and latency matter more, GPT-6 Astra uses far fewer tool calls. The AA-3D Explorer lets you open every scene and compare results directly.
Benchmark side-by-side against alternatives, or calculate monthly token cost vs subscription break-even.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.