Independent evaluator Artificial Analysis published two new results on November 10. On AA-3D, which tests how well a model acting as an agent builds interactive three.js web scenes, Claude Fable 5.2 (Max) scores 1271 Elo, 67 points ahead of second-place Claude Sonnet 5.5 (1204); its 95% confidence interval of 1246 to 1297 does not overlap any other model, so the lead is outside the margin of error. It is 132 points above Fable 5.1 (1139) and ahead of the top OpenAI and Google entries, GPT-6 Astra (1168) and Gemini 4 Argon (1147). On VIALS-AA, a life-science image reasoning benchmark, Fable 5.2 scores 67%, ahead of previous leader Gemini 4 Carbon (64%) and GPT-6 Astra (63%). AA also found opposite strategies: Fable averages about 37 tool calls per task, Astra about 8.

Key Takeaways

  • ✓AA-3D: Fable 5.2 (Max) 1271 Elo vs Sonnet 5.5 1204 and Opus 5.5 1202; its 95% CI of 1246-1297 overlaps no other model
  • ✓Generational gain: 132 points above Fable 5.1 (1139); the top OpenAI entry GPT-6 Astra scores 1168, the top Google entry Gemini 4 Argon 1147
  • ✓AA-3D setup: each model works as an agent in an offline sandbox for up to 3 hours / 250 turns with Blender, Rapier physics, Python and a headless browser; human panelists vote on blind pairs after at least 30 seconds per scene
  • ✓VIALS-AA: Fable 5.2 67%, Gemini 4 Carbon 64%, GPT-6 Astra 63%
  • ✓Opposite tool strategies: Fable makes about 37 tool calls per task and 1.60 per turn (highest on the board); Astra makes about 8, the fewest AA has measured
Artificial Analysis: Claude Fable 5.2 Takes #1 on the AA-3D Interactive 3D Benchmark at 1271 Elo, 67 Points Clear, and Leads the VIALS-AA Scientific Image Reasoning Benchmark at 67%
🖼️Official Media
Click to view high-res
🧭

Turn your technical choice into a development budget

Compare 40 dev plans & simulate token costs vs $20/mo subscriptions

🔬

In-Depth Technical Analysis

Background and Pain Points

After Claude Fable 5.2 launched, the key question was whether Anthropic's own numbers would hold up under third-party testing. Standard Q&A and coding leaderboards rarely separate frontier models anymore. Developers want to know whether a model can build a complete, good-looking interactive artifact on its own, and whether it can reason reliably about scientific images. Artificial Analysis's AA-3D and VIALS-AA target exactly these two needs, and both are independent evaluations rather than vendor claims.

Architecture Highlights

AA-3D runs each model as an agent in an offline sandbox. Given a written brief, such as an animated Starship mission from launch through booster catch to ship landing, it builds a three.js web page within 3 hours and 250 turns, using Blender, the Rapier physics engine, Python and a headless browser to test its own work. Human panelists vote on blind pairs built from the same brief, spending at least 30 seconds with each scene, and votes become Elo ratings. VIALS-AA is AA's implementation of Handshake AI's VIALS benchmark, covering life-science images such as gel blots, plasmid maps and phylogenies.

Benchmarks

AA-3D: Fable 5.2 (Max) 1271 Elo, Sonnet 5.5 1204, Opus 5.5 1202, GPT-6 Astra 1168, Gemini 4 Argon 1147, Fable 5.1 1139. Fable 5.2's 95% confidence interval of 1246 to 1297 overlaps no other model. VIALS-AA: Fable 5.2 scores 67%, ahead of previous leader Gemini 4 Carbon (64%) and GPT-6 Astra (63%). Fable averages about 37 tool calls per task, mostly cropping and viewing images, while Astra averages about 8. Stronger Anthropic models call more tools; stronger OpenAI models call fewer. All figures are AA's independent results.

Getting Started

For 3D web pages, visualizations and game prototypes, Fable 5.2 now leads the third-party board, but AA-3D used the Max setting, which is slow and costly at $8/$40 per million tokens, so try lower effort first. For scientific or inspection tasks that require reading images, give it image cropping and code execution tools and it will check its work over many steps; if call count and latency matter more, GPT-6 Astra uses far fewer tool calls. The AA-3D Explorer lets you open every scene and compare results directly.

Action HubReady to adopt this in production?

Benchmark side-by-side against alternatives, or calculate monthly token cost vs subscription break-even.

Up NextSemiAnalysis releases GDPx, an agentic benchmark of 206 tasks across 11 high-value domains where the top model, Claude Opus 5.5, scores just 12%
Read Now→