AI Coding Live News

Artificial Analysis Benchmarks Devin Fusion: Scoring 68.1 on Coding Agent Index While Slashing Task Cost by 31%

Artificial Analysis released an independent evaluation of Cognition's new coding agent, Devin Fusion. Moving beyond single-model execution, Devin Fusion employs an asymmetric multi-agent architecture pairing Claude Opus 5.5 (max) as the lead reasoning orchestrator alongside GPT-6 Luna (high) as a high-speed parallel worker. In the standardized Coding Agent Index, Devin Fusion achieved an elite score of 68.1 (matching Muse Code at 68.0 and rivaling Claude Code Sonnet 5.5 at 68.4). Crucially, the hybrid architecture slashes average task expense from $13.04 down to $9.01 (a 31% cost reduction) while shortening execution runtime from 65 to 55 minutes.

Artificial Analysis Benchmarks Devin Fusion: Scoring 68.1 on Coding Agent Index While Slashing Task Cost by 31%

Key Takeaways

  • Artificial Analysis independently benchmarked Devin Fusion, scoring 68.1 on the standardized Coding Agent Index
  • Pioneers asymmetric model collaboration: Claude Opus 5.5 orchestrates architecture while GPT-6 Luna executes parallel sub-tasks
  • Cuts per-task execution costs from $13.04 to $9.01 (a 31% savings) and trims average completion time from 65 to 55 minutes
  • Outperforms Claude Code with Opus 5.5 on DeepSWE v1.1 (72.6% vs 68.4%) and SWE-Atlas-QnA (69.6% vs 66.4%)
Read full story

Devin Fusion with an Opus 5.5 lead and GPT-6 Luna sidekick tops the Artificial Analysis Coding Agent Index at 68.1, at what Cognition says is 31% lower cost per task than Claude Code with Opus 5.5

Cognition said on October 19 that Devin Fusion, pairing Claude Opus 5.5 as the lead with GPT-6 Luna as the sidekick, scored 68.1 on the Artificial Analysis Coding Agent Index v1.5. Artificial Analysis's current data puts it first, but only 0.1 ahead of Muse Code with Muse Wonder Full at 68.0, effectively a tie; Antigravity CLI with Gemini 4 Argon is third at 63.8. Cognition says the pairing costs 31% less per task than Claude Code with Opus 5.5 (vendor-reported). Fusion ships in Devin CLI and Desktop.

Devin Fusion with an Opus 5.5 lead and GPT-6 Luna sidekick tops the Artificial Analysis Coding Agent Index at 68.1, at what Cognition says is 31% lower cost per task than Claude Code with Opus 5.5

Key Takeaways

  • 68.1 overall: DeepSWE v1.1 72.6, SWE-Atlas-QnA 69.6, Terminal-Bench v4 62.1, equally weighted (Artificial Analysis data).
  • Just 0.1 ahead of Muse Code with Muse Wonder Full (68.0); Antigravity CLI with Gemini 4 Argon 63.8, Codex with GPT-6.1 Sol (xhigh) 62.9.
  • Cost: Cognition says 31% lower per task than Claude Code with Opus 5.5 (vendor-reported).
  • Earlier, Fusion with Fable 5.1 + SWE-2 cut DeepSWE 1.1 cost per task from $14.63 to $7.88 (-46%) while scoring 63.1 vs 64.3.
  • Recommended pairing is Opus 5.5 + GPT-6 Luna, available by installing Devin CLI.
Read full story

Artificial Analysis: Devin Fusion joins Coding Agent Index; Fable scores 62, Astra cheaper/faster

Artificial Analysis independently benchmarked Devin Fusion—the first multi-model coding agent on their Coding Agent Index. Claude Fable 5.1 (xhigh)+SWE-2 scores 62; GPT-6 Astra (xhigh)+SWE-2 scores 59 with ~43% lower cost and ~31% faster completion while retaining frontier-level performance.

Key Takeaways

  • First multi-model coding agent on Artificial Analysis Coding Agent Index.
  • Fable 5.1+SWE-2 scores 62; Astra+SWE-2 scores 59.
  • Astra config ~43% cheaper and ~31% faster task completion.
Read full story