LMArena (@arena) breaks down Gemini 3.8 Flash (High) vs 3.7 Flash (High) on Agent Arena: net improvement jumps from +0.84% (#32) to +5.94% (#14). Agent Arena scores relative gains on real long-horizon tasks with web, filesystem, and terminal tools. Among five signals, Praise vs Complaint improves most (+14.78% vs -1.60%); Confirmed Success and Bash Recovery also rise, while Steerability remains a relative weakness but better than 3.7.
Key Takeaways
- ✓Agent Arena net +5.94% and #14 overall, up from +0.84%/#32 on 3.7 Flash (High).
- ✓Praise vs Complaint +14.78% vs -1.60%; Confirmed Success and Bash Recovery also improve.
- ✓Steerability still weak (-1.43%) but better than 3.7; Tool Hallucination remains clean for both.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.