AI Coding Live News

Cognition, the company behind Devin, posted on X at 01:45 UTC on Oct 30 that Google's new Gemini 4 Carbon scores 40% on its FrontierCode 2.0 coding benchmark at $4.04 per task, near the top and behind only Claude Opus 5.5, GPT-6 Astra and Claude Sonnet 5.5. The earlier Gemini 4 Argon scores 26.3% at a higher $6.41 per task. The results are Cognition's own runs, and the leaderboard on its site has been updated.

Zoom

On Oct 29 Mistral released an improved Mistral Large 4 (Le Chonk) with open weights on Hugging Face (plus an NVFP4 quantized checkpoint), served on its API as mistral-large-4. After about three more weeks of reinforcement learning since the early-October preview, Mistral reports 19.7% on FrontierCode 2.0, Terminal-Bench 4.0 up from 28% to 41%, and new low/medium/high reasoning modes. The license is a modified MIT that allows commercial use, but running a model-as-a-service business needs a separate commercial license.

Zoom

On Oct 28 independent evaluator Artificial Analysis released Intelligence Index v5, its biggest revision since v4 in January: it adds Cognition's FrontierCode 2.0 and Terminal-Bench-Science, swaps Humanity's Last Exam for HLE-Diamond, and now draws 60% of its weight from private or held-out test sets. Claude Opus 5.5 (max) leads at 58, ahead of GPT-6 Astra at 57 and GPT-6.1 Sol at 55; the top open-weights model, Kimi K3.1 Pro (weights not yet released), scores 46, widening the gap from 3 points in v4.3 to 12. It also launched Progress Index v1 for comparing models across years.

Zoom

Cognition, the maker of Devin, released FrontierCode 2.0 on Oct 27. It keeps the method of maintainer-written tasks graded on whether the code is actually mergeable, but draws tasks from more repositories, adds security patches and performance work, uses deliberately underspecified prompts and adds many thoroughness criteria. In Cognition's results Claude Opus 5.5 leads at 45.5%, GPT-6 Astra follows at 42.8%, and Grok 4.7 and Gemini 4 Argon drop into the 20s, leaving the benchmark far from saturated.

Zoom

On 2026-10-23 Artificial Analysis launched Coding Agent Index v2.0, which scores model-plus-harness combinations across 290 tasks with three equally weighted benchmarks: FrontierCode v1.1 from Cognition (100 tasks on real open-source repos, graded on whether a maintainer would merge the change) replaces DeepSWE v1.1, SWE-Atlas-QnA becomes the stricter SWE-Atlas-QnA-AA, and Terminal-Bench 4.0 is unchanged. Claude Code with Claude Opus 5.5 (max) leads at 61.7, ahead of Sonnet 5.5 at 59.3 and Muse Wonder Full at 58.9. Scores fall across the board: the 21 configurations measured on both versions drop from a mean of 54.8 to 47.4.

Zoom