Alibaba Qwen amplified Accio’s open-source CommerceAgentBench and said Qwen3.8-Max posted the strongest overall result among open-weight models. The benchmark scores execution on real commerce operations rather than what a model says; early numbers put the best overall completion rate around 62%. Teams wiring agents into ordering, fulfillment, or support now have a public leaderboard for multi-step commercial work—and a reminder that even the leader still fails a large share of tasks.

Key Takeaways

  • ✓CommerceAgentBench is open-source and scores commerce execution, not chat answers.
  • ✓Best overall completion is about 62%; Qwen3.8-Max leads among open-weight models.
  • ✓The gap is a signal that multi-step commercial agents still fail a large share of real workflows.
⚡

Key Decision Metrics at a Glance

TL;DR Verdict
🏆 Benchmark RankRank
CommerceAgentBench is open-source and scores commerce execution, not chat answers.
Full Leaderboard→
💰 Cost & PlansCompare
Qwen3.8-Max · in: $2 / out: $6
Compare Plans↗
🛠️ Ecosystem & IDERules
Qwen3.8-Max · CommerceAgentBench · open weights
Setup IDE Rules↗
🧭

Turn your technical choice into a development budget

Compare 40 dev plans & simulate token costs vs $20/mo subscriptions

⚔️ Compare Model→💰 Compare plans & limits↗
Action HubReady to adopt this in production?

Benchmark side-by-side against alternatives, or calculate monthly token cost vs subscription break-even.

⚔️ Launch VS Compare→💳 View Plans↗
Up NextLiveMACE Benchmark Unmasks Agent Decision Blackboxes in Live Evolving Markets: Decoupling Compliance from Volatility
Read Now→