AI Coding Live News

On October 31, independent evaluator Artificial Analysis released AA-Omniscience v1.1, its knowledge and hallucination benchmark and part of Intelligence Index v5. The question set shrinks from 6,000 to 3,000, dropping previously public and saturated questions, fixing errors and ambiguities, and adding new ones, and a new 300-question public set on Hugging Face is calibrated to the private set's difficulty, with 0.99 Pearson and Spearman correlation on Net Score. Gemini 4 Carbon (high) leads with a Net Score of 54, ahead of Claude Opus 5.5 at 48 and Claude Fable 5.1 at 46; Fable 5.1 has the highest accuracy (68%) and Gemini 4 Argon the lowest hallucination rate (4%). Models score about 1.9 points lower than on v1 on average, and MiniMax M3.1 Flash drops 22 points. All figures are as reported by Artificial Analysis.

Zoom

Artificial Analysis launched AA-PersonalityBench (@ArtificialAnlys), an innovative behavioral benchmark quantifying psychological traits in frontier LLMs, with initial rankings focusing on Confidence (uncertainty calibration) and Sycophancy (tendency to agree with user misconceptions). The data revealed that Google's Gemini 3.8 Flash (100) and Gemini 4 Argon (97) displayed the highest assertiveness while being the least likely to admit uncertainty. Conversely, on sycophancy tests, Llama 4 Maverick scored 97 (frequently validating flawed user prompts), whereas Claude Fable 5.1 scored a near-flawless 4, refusing to flatter and rigorously holding factual ground.

Zoom

On October 21 the startup Breken launched its product of the same name as "production engineering". It rebuilds the whole application in an isolated environment, grows production data at 4,000x speed, lets synthetic users and agents with intent and limited patience use it, and varies one condition at a time, such as a retry, a lost response or a clock jump. When a failure reproduces every time it hands back the state, a trace and a draft fix PR. It also published an open benchmark, ESCAPES: 327 bugs from 33 open-source products that reached users. Scanning each product once on its July 1 code, Breken caught 76 of the 235 bugs already present (32%), against 37 (16%) for Claude Fable 5.1 in Claude Code. These are vendor-run results.

Zoom

Artificial Analysis released AA-Robotics v0.1 on 2026-10-14, a research preview in which frontier models running inside coding-agent harnesses (Codex, Claude Code, Antigravity) control a 6-axis robot arm over an HTTP API across eight tabletop tasks. GPT-6 Astra scores 69.4, ahead of GPT-6.1 Sol (64.6), Gemini 4 Argon (55.3), Claude Opus 5.5 (48.8) and Claude Fable 5.1 (46.3). Models take about 30 minutes per task versus roughly 20 seconds for a human.

Zoom

Anthropic / Claude (@claudeai; confirmed by @AnthropicAI) launched Claude Opus 5.5 today, the first model in the new Claude 5.5 family. Officially it matches Claude Fable 5.1 on most tasks, and is a major step up from Opus 5 on agentic coding, computer use, and knowledge work. At default settings typical workloads cost about 40% less than Opus 5. Pro, Max, and Team five-hour usage limits are increased, with a bankable rate-limit reset for subscribers.

Zoom

@ArtificialAnlys evaluated Grok 4.7 (xhigh): Intelligence Index 46 (+2 vs 4.6), putting SpaceXAI in the top 4 labs. With Grok Build it scores 56 on the Coding Agent Index (+9 vs 4.6), 4th among native harnesses behind Claude Fable 5.1, GPT-6 Astra, and Claude Opus 5. Pricing stays $2/$6 per 1M in/out ($0.50 cache hits), 500k context.

Zoom