AI Coding Live News

Arena Code Arena: WebDev Update: DeepSeek-V4.1-Flash Becomes #1 Open Model, Scoring 1670 to Rival GPT-6 Sol and Surpass Claude Opus 5

Arena announced a major update to Code Arena: WebDev: DeepSeek-V4.1-Flash-20261017 (Max) clinched the #1 position among open models with 1670 points, surpassing Kimi K3 (Max) at a 10x lower cost. Ranking #12 overall, it outperforms Claude Opus 5 (High) and narrows the gap with closed-source frontier GPT-6 Sol (Max) to roughly 10 points, resetting the Pareto efficiency curve at $0.30 input / $1.20 output per million tokens.

Arena Code Arena: WebDev Update: DeepSeek-V4.1-Flash Becomes #1 Open Model, Scoring 1670 to Rival GPT-6 Sol and Surpass Claude Opus 5

Key Takeaways

  • DeepSeek-V4.1-Flash-20261017 (Max) captured the #1 open model position in Arena Code Arena: WebDev with 1670 points, surpassing Kimi K3 (Max)
  • Ranks #12 overall on the leaderboard, defeating Claude Opus 5 (High) and trailing closed-source champion GPT-6 Sol (Max) by only ~10 points
  • Resets the Pareto efficiency frontier at $0.30 input / $1.20 output per million tokens, cutting operational costs by ~10x against rival models
  • Gains +52 points over its previous 20260910 checkpoint in just over a month
Read full story
Linked Models & Agents:

Nanjing University LAMDA Unveils AgenticBBO-Bench: Benchmarking LLM Agents for Black-Box Optimization, Outperforming Top Numerical Solvers

Black-box optimization (BBO) poses foundational computational hurdles across chip design, database parameter tuning, hyperparameter optimization, and molecular engineering where objective function evaluations are prohibitively expensive and gradients are unavailable. Traditional Bayesian optimization and evolutionary algorithms rely strictly on numerical samples while discarding rich task semantics, whereas direct LLM prompting struggles with numerical precision and hallucinations. Researchers from Nanjing University's National Key Laboratory for Novel Software Technology (LAMDA Group) introduce AgenticBBO-Bench (arXiv:2610.12183), the first unified cross-domain benchmark for evaluating LLM agents in black-box optimization. Spanning synthetic functions, hyperparameter tuning, database configuration, chip layout, and molecular design under a standardized finite-budget protocol, Agentic BBO achieves superior family-averaged scores over direct LLM methods across all five domains and outperforms the strongest numerical optimizers in four. Evaluating seven frontier LLMs within the Codex agent harness establishes the Pareto frontier of performance and inference cost, with the benchmark and harness fully open-sourced.

Key Takeaways

  • Nanjing University LAMDA releases AgenticBBO-Bench, benchmarking LLM agents across chip design, DB tuning, and molecular optimization
  • Agentic BBO outperforms direct LLM prompting across all 5 domains and beats leading numerical optimizers in 4 out of 5 areas
  • Maps Pareto frontier of frontier models within Codex harness, cutting required optimization steps by over 38% under finite budgets
Read full story

Ant Group Open-Sources Mara Chain: Rethinking Failure as a Stepping Stone for Autonomous Agent System Evolution

Modern AI agent systems and autonomous frameworks rely heavily on greedy search or reinforcement learning for self-evolution (such as harness synthesis, workflow routing, and prompt optimization). However, in non-convex and deceptive optimization landscapes, greedy pruning prematurely discards mutations that temporarily underperform, stranding systems in local optima. Researchers from Ant Group Research, Peking University, and Beijing Academy of Artificial Intelligence (BAAI) unveil Mara Chain (arXiv:2609.35855), an evolutionary optimization framework that rethinks failures as essential stepping stones. Mara Chain operates via three interconnected mechanisms: a stepping-stone archive combining semantic embeddings and execution traces for novelty preservation, a hierarchical mutator driven by backward failure attribution, and a Pareto-optimal non-dominated sorting selection module. On the AppWorld benchmark, Mara Chain achieves up to a 20.5% performance improvement over leading baselines (GEPA, ACE, SkillOpt-Lite) while requiring 65.5% fewer rollouts. On TerminalBench 2.1, it outstrips AHE and Meta-Harness by 20.2 and 22.5 percentage points respectively. The team has open-sourced the implementation under the AntOmniEvo repository.

Key Takeaways

  • Ant Group, PKU, and BAAI unveil Mara Chain, rethinking failed mutations as stepping stones to bypass local optima in agent self-evolution
  • Outperforms GEPA and ACE by up to 20.5% on AppWorld with 65.5% fewer rollouts, and beats AHE by 20.2 percentage points on TerminalBench 2.1
  • Open-sources the complete AntOmniEvo framework with AST-aware stepping-stone buffering and hierarchical failure mutators
Read full story

OpenRouter ships Model Router Benchmarks: 7 routers vs 6 suites on quality, speed, and cost

On 2 Oct 2026 OpenRouter shipped Model Router Benchmarks: seven model routers (Auto, Jev, NVIDIA Switchyard, Unbiased Pareto, Sakana Fugu, and variants) compared on GPQA Diamond, Tau3 Banking, MMMU Pro Vision, SWE Atlas QA, Deep SWE, and Terminal Bench 2.1. The Router Index defaults to quality 60% / time 20% / cost 20%. openrouter/pareto-code and Fusion are not on this board.

OpenRouter ships Model Router Benchmarks: 7 routers vs 6 suites on quality, speed, and cost

Key Takeaways

  • Announced 2026-10-02 22:08 UTC; blog by Brian Thomas dated 10/2/2026; live page openrouter.ai/benchmarks/routers
  • Seven router slugs in the public stats feed: openrouter/auto, typesafe/jev-router, nvidia/switchyard, unbiased/pareto, sakana/fugu-max, sakana/fugu-ultra, sakana/fugu-ultra-v2. pareto-code and Fusion were not benchmarked
  • Router Index default is quality 60% / time 20% / cost 20% on a 0-10 scale; it is not raw accuracy
  • Stats API 2026-10-04 SGT, Deep SWE n=113: Switchyard Flash+Opus 5.5 and Opus-only both 83/113 (~$279 / $285); Flash+GPT-6 Sol 74/113 at ~$55
  • Terminal Bench 2.1 n=89: GPT-6 Astra 77/89 ($66.50), Opus 5.5 74/89 ($24.00); one Pareto run 71/89 ($27.20)
Read full story
Linked Models & Agents:
⚡ openrouter/auto⚡ typesafe/jev-router⚡ nvidia/switchyard⚡ unbiased/pareto⚡ sakana/fugu-ultra-v2⚡ openrouter/pareto-code🌐 OpenRouter🌐 NVIDIA🌐 Sakana🌐 TypeSafe🌐 Unbiased
ADSponsored
A
AgentField / Santosh Radha@Agent-Field·
👀81
🔥95

AgentField open-sources CodeAF v0.6: one Go binary software factory for open models; vendor DeepSWE 54.9% #1 same-model

CodeAF is an Apache-2.0 Go binary that runs open-weight models as a local software factory with task fan-out and Pareto crewing. v0.6.0 shipped 2026-10-01; ★259 now. Vendor DeepSWE doc: /senior-dev solved 62/113 (54.9%) on DeepSeek V4 Flash vs nine other harnesses—with stated one-seed and sampling caveats.

AgentField open-sources CodeAF v0.6: one Go binary software factory for open models; vendor DeepSWE 54.9% #1 same-model

Key Takeaways

  • Agent-Field/CodeAF Apache-2.0; ★259 / 34 forks; install via agentfield.ai/get/codeaf
  • v0.6.0 published 2026-10-01T18:59:00Z; README still says early preview
  • Vendor DeepSWE same-model table: senior-dev 62/113 (54.9%) at ~22¢/task vs nine harnesses—one seed; sampling-contract caveat documented
  • Later same 113 tasks: 88/113 (77.9%) on DeepSeek V4.1 Flash; 78/113 (69.0%) on Kimi K3 (senior-dev only)
  • Built-in providers include OpenRouter, DeepSeek, GLM, Kimi, MiniMax, Qwen, Codex, Ollama; default worker/planner/checker crew
Read full story

Cline 4.1.22: GPT-6.1 Sol becomes default across gateways; Anthropic server-side refusal fallback; Bee & Pareto providers

Cline shipped v4.1.22 on 2026-09-30 (59 commits ahead of v4.1.21): refreshed catalog makes GPT-6.1 Sol the default for OpenAI, OpenRouter, GitHub Copilot, Requesty and more when unpinned; direct Anthropic uses server-side refusal fallback with OpenRouter/Cline failover; adds Bee (HEOSSI) and Pareto Inference (PARETO_API_KEY); fixes cancel races, double-counted reasoning tokens, and Bedrock inference-profile routing. SDK @cline/[email protected] ships the same day.

Cline 4.1.22: GPT-6.1 Sol becomes default across gateways; Anthropic server-side refusal fallback; Bee & Pareto providers

Key Takeaways

  • Release v4.1.22; 59 commits ahead of v4.1.21
  • Unpinned defaults: GPT-6.1 Sol on OpenAI/OpenRouter/Copilot/Requesty and more; Vercel AI Gateway→Ling 3.1 Flash; CrossModel/Ofox→Sonnet 5.5
  • Anthropic server-side refusal fallback + OpenRouter/Cline allow_fallovers; content-filter finish reason instead of empty response
  • New providers: Bee (HEOSSI), Pareto Inference (PARETO_API_KEY)
  • SDK @cline/[email protected]; docs https://docs.cline.bot/
Read full story

Xiaomi open-weights MiMo-V2.6-Pro: AA Intelligence Index 46, tops open weights on cost frontier

@ArtificialAnlys reports Xiaomi released open-weights MiMo-V2.6-Pro: Artificial Analysis Intelligence Index 46 (up from 26 on V2.5-Pro), now the top open-weights model, landing on the intelligence-vs-cost Pareto frontier at about $0.13 per Index task with unchanged token prices ($0.435/M input with 99% cache-hit discount, $0.87/M output). It is a 1.02T-total / 42B-active MoE.

Xiaomi open-weights MiMo-V2.6-Pro: AA Intelligence Index 46, tops open weights on cost frontier

Key Takeaways

  • Open weights: AA Intelligence Index 46, big jump from V2.5-Pro (26) and tops open-weights.
  • Cost: ~$0.13/task; $0.435/M input (99% cache-hit discount) and $0.87/M output unchanged.
  • Architecture: 1.02T-total / 42B-active MoE; more AA analysis forthcoming.
Read full story
Linked Models & Agents:
⚡ Xiaomi Mimo V2 6 Pro

Cloudflare AI adds Union Alpha Pareto, claiming Fable- and Astra-level intelligence at one-quarter the cost

CloudflareDev announced Union Alpha as The Unbiased Co.'s Pareto model, claiming intelligence comparable to Fable and Astra at one-quarter the cost. Bringing that cost-performance point into Cloudflare AI gives coding agents and other high-frequency workflows another model-routing option.

Key Takeaways

  • Union Alpha is presented as The Unbiased Co.'s Pareto model.
  • Cloudflare claims intelligence comparable to Fable and Astra at roughly one-quarter of the cost.
  • A lower-cost model option gives coding agents another route for high-frequency calls and budget-aware routing.
Read full story
Linked Models & Agents:
⚡ Union Alpha🌐 cloudflare

OpenRouter reveals Union Alpha as TheUnbiasedCo Pareto after early unmasking

OpenRouter confirmed that the stealth model previously listed as Union Alpha is TheUnbiasedCo Pareto. Community detective work and demand shortened the stealth period; the model remains available on OpenRouter at openrouter.ai/unbiased/pareto.

Key Takeaways

  • Union Alpha is confirmed as TheUnbiasedCo Pareto, ending its stealth listing early.
  • OpenRouter says community demand shortened the stealth period while existing access continues.
  • Developers can route to Pareto on OpenRouter to compare price and quality against other models.
Read full story
Linked Models & Agents:

Agent Arena: DeepSeek-V4.1-Flash (Max) reshapes open-model Pareto frontier at ~$0.07/task

Arena.ai (@arena) reports Agent Arena results: DeepSeek-V4.1-Flash (Max) posts about +4.87% net improvement at roughly $0.07 median task cost — lowest among the top-3 open models — retaining ~98% of Hy4 preview’s net gain at ~73% lower cost and ~76% of Kimi K3 (Max) performance at ~92% lower cost.

Key Takeaways

  • DeepSeek-V4.1-Flash (Max) enters Agent Arena at about +4.87% net improvement.
  • Median task cost ~$0.07 — cheapest among top-3 open models.
  • Beats Hy4 / Kimi K3 on cost-efficiency and reshapes the Pareto frontier.
Read full story
Linked Models & Agents:
ADSponsored

Databricks day-0 DeepSeek 4.1 Flash via Unity Gateway; Pareto on OfficeQA Pro V2

Databricks shipped DeepSeek 4.1 Flash on Unity Gateway the day it launched. On OfficeQA Pro V2 it sits on the Pareto frontier, so teams can point governed Lakehouse data at the model for apps and agents under one access, spend, and performance layer.

Key Takeaways

  • DeepSeek 4.1 Flash is on Databricks Unity Gateway day-0.
  • Pareto-frontier results on OfficeQA Pro V2 for enterprise document reasoning.
  • Build governed apps/agents on Lakehouse data with unified access, spend, and performance.
Read full story

Cognition launches SWE-2: frontier-parity coding model at up to ~70% lower cost

Cognition introduced SWE-2, calling it their closest model yet to the frontier: on leading evals it matches recent frontier models at up to ~70% lower cost. They say they scaled RL to multiple trillions of parameters with a refined recipe that pushes the Pareto curve on both capability and cost. SWE-2 already powers products such as Devin Voice.

Key Takeaways

  • SWE-2 claims parity with recent frontier models on leading coding evals.
  • Up to ~70% lower cost at similar capability; Pareto-focused release.
  • RL scaled to multi-trillion parameters; already used in Devin products.
Read full story
Linked Models & Agents:

LMArena: GPT-6 Astra (Max) tops Code Arena WebDev at 1797, +35 over Fable 5.1 Max

LMArena: OpenAI GPT-6 Astra (Max) takes #1 on Code Arena WebDev at 1797 pts, about +35 over Claude Fable 5.1 (Max) at 1762 and ahead of Claude Opus 5 (Max) and GPT-5.6 Sol (xHigh). It also reshapes the quality-price Pareto frontier at ~$40/Mtoken matching latest Claude pricing, on agentic web-dev workflows with multi-step reasoning and tool use.

Key Takeaways

  • Astra (Max) scores 1797 on WebDev, ~+35 over Fable 5.1 Max (1762).
  • Best-performing model on the ~$40/Mtoken Pareto frontier, matching latest Claude pricing.
  • Ranks agentic web-dev workflows with multi-step reasoning and tool use.
Read full story

Artificial Analysis Intelligence Index v4.2: Fable 5.1 leads, Astra second

Artificial Analysis shipped Intelligence Index v4.2: adds private agentic knowledge-work eval AA-Briefcase and long-document GDP.pdf, doubles held-out weighting, upgrades grading, and drops saturated GPQA Diamond. Claude Fable 5.1 leads; GPT-6 Astra is second with ~4pt gain over GPT-5.6 Sol and strong output-token Pareto efficiency. A major interim benchmark refresh for model selection and cost/quality tradeoffs.

Key Takeaways

  • Bench: v4.2 adds AA-Briefcase and GDP.pdf; held-out weight ~40%.
  • Leaderboard: Claude Fable 5.1 first, GPT-6 Astra second (~+4 vs Sol).
  • Efficiency: Astra stands out on the output-token Pareto frontier.
Read full story
Linked Models & Agents:

LMArena: Claude Fable 5.1 Max tops Code Arena WebDev at 1765 (~77 pts ahead)

Arena.ai reports Claude Fable 5.1 (Max) takes #1 on Code Arena: WebDev at 1765 pts—up from Fable 5 (Max) at #8 / 1628 (+137 overall)—and leads Qwen3.8-Max-0902 by ~77 pts. It ranks #1 in five of six domains with large gains in Gaming, Simulations, and Reference-Based Design, and at ~$40/MToken reshapes the higher-price Pareto frontier.

Key Takeaways

  • Overall: WebDev 1765 #1 vs Fable 5 Max 1628/#8 (+137); ~77 pts over #2.
  • Domains: #1 in five of six; Gaming +234, Simulations +196, Reference-Based Design +160.
  • Cost: ~$40/MToken, lifting the higher-price Pareto performance bar.
Read full story
Linked Models & Agents: