LMArena (@arena) breaks down Gemini 3.8 Flash (High) vs 3.7 Flash (High) on Agent Arena: net improvement jumps from +0.84% (#32) to +5.94% (#14). Agent Arena scores relative gains on real long-horizon tasks with web, filesystem, and terminal tools. Among five signals, Praise vs Complaint improves most (+14.78% vs -1.60%); Confirmed Success and Bash Recovery also rise, while Steerability remains a relative weakness but better than 3.7.

Key Takeaways

  • Agent Arena net +5.94% and #14 overall, up from +0.84%/#32 on 3.7 Flash (High).
  • Praise vs Complaint +14.78% vs -1.60%; Confirmed Success and Bash Recovery also improve.
  • Steerability still weak (-1.43%) but better than 3.7; Tool Hallucination remains clean for both.
ADSponsored