AI Coding Live News

Independent evaluator Artificial Analysis announced on X on November 4 that its six Capability Indexes (Finance & Accounting, Strategy & Ops, Legal, Healthcare & Medical, Engineering, Economics) are now v2.0, aligned with Intelligence Index v5.0 evaluations and weighting Non-Hallucination and Agentic Tool Use more heavily. Across the indexes, HLE becomes HLE-Diamond, AA-Omniscience moves to v1.1 and GDPval-AA is removed; Engineering gains a new Science capability. Per Artificial Analysis, Claude Opus 5.5 (max) leads all six, with GPT-6 Astra (max) second in Finance & Accounting, Legal and Engineering. Among open-weights models, Kimi K3.1 Pro (weights not yet released) leads all six at #5 to #8.

Zoom

On October 31, independent evaluator Artificial Analysis released AA-Omniscience v1.1, its knowledge and hallucination benchmark and part of Intelligence Index v5. The question set shrinks from 6,000 to 3,000, dropping previously public and saturated questions, fixing errors and ambiguities, and adding new ones, and a new 300-question public set on Hugging Face is calibrated to the private set's difficulty, with 0.99 Pearson and Spearman correlation on Net Score. Gemini 4 Carbon (high) leads with a Net Score of 54, ahead of Claude Opus 5.5 at 48 and Claude Fable 5.1 at 46; Fable 5.1 has the highest accuracy (68%) and Gemini 4 Argon the lowest hallucination rate (4%). Models score about 1.9 points lower than on v1 on average, and MiniMax M3.1 Flash drops 22 points. All figures are as reported by Artificial Analysis.

Zoom

Researchers introduced OverSeer in arXiv:2610.28554, pioneering a new class of multi-agent world models operating beyond the field of view of individual agents. Standard video world models collapse in multi-agent environments because individual agents operate under partial observability; naive frameworks feeding external global map inputs suffer severe spatial inconsistency and state hallucination. OverSeer resolves this by jointly predicting auxiliary spatial representation streams alongside the agents' first-person camera streams. In comprehensive Minecraft benchmarks, OverSeer achieves decisive state-of-the-art results across physical grounding, long-horizon spatial memory, and cross-view consistency.

Zoom

Researchers from Alibaba and collaborating academic institutions introduced FocusGUI in arXiv:2610.26203, establishing a focused attention architecture for streaming omni-modal GUI agents. Across streaming observations of continuous UI screenshots, synchronous audio, and device state histories, agents routinely suffer from 'Sequential Distraction'—where transient visual clutter from previous steps compounds into catastrophic action hallucination. FocusGUI preserves the base model while introducing action-sufficient projection and channel decomposition. Tested across 29 smartphone apps on OmniGUI, FocusGUI elevates Type Match from 31.0% to 64.2% and Exact Match from 11.2% to 33.5% across four omni-modal foundation backbones.

Zoom

Researchers introduced Matrix-Game 4.0 in arXiv:2610.27999, bridging the chasm between controllable video generation and genuinely playable, interactive virtual worlds. Current video world models suffer from severe state hallucination, inability to enforce rigid game mechanics (collision physics, inventory, win/loss rules), and sluggish response latency. Matrix-Game 4.0 resolves these barriers by decoupling game logic execution from visual synthesis through an executable game harness. A lightweight runtime tracks deterministic game states and rules, steering high-fidelity streaming video backbones to deliver playable, persistent, and low-latency virtual game environments.

Zoom

Researchers introduced ActionRoPE and Coordinate-Conditioned Noise Scheduling (CNS) in arXiv:2610.25861, solving spatial inconsistency in planar-camera game world models. In top-down and isometric gaming environments, naive feature-conditioned action mechanisms cause severe hallucination and revisit drift when players return to previously observed scenes. ActionRoPE directly converts action-induced camera displacements into world-coordinate rotary position embeddings (RoPE), ensuring identical physical world coordinates retain persistent token addresses across time. Benchmarks reveal that ActionRoPE cuts revisit drift by 66% over the strongest baseline while transferring across 1.3B to 33B parameter video backbones.

Zoom

Liquid AI released d1-ultra on Oct 15: a multimodal decision model that takes text and images and, in one forward pass, returns probabilities for yes/no, choice and score questions without generating tokens; billed on input only. Artificial Analysis ranks it #1 on Decision Index v1.0 at 65, at least 8 points ahead, with an 85% non-hallucination rate. Available on the Liquid API, Vercel AI Gateway and OpenRouter.

Zoom

Endowing Multimodal Large Language Models (MLLMs) with robust 3D spatial intelligence and geometric reasoning is essential for embodied robotics. Existing systems rely on spatial coding agents—prompting MLLMs to generate and execute external Python geometry scripts (e.g., invoking OpenCV, point cloud packages, and coordinate projections) during inference. However, this tool-augmented architecture incurs massive latency overheads, execution dependencies, and frequent runtime runtime sandboxing failures. In newly released research (arXiv:2610.11366), researchers introduce SpatialOPSD (code: github.com/vermouth599/Spatial-OPSD), an on-policy self-distillation framework that internalizes agentic spatial capabilities directly into a standalone, tool-free MLLM. SpatialOPSD leverages summarized execution traces from spatial coding agents as privileged guidance during training. To prevent privileged information leakage from inducing repetitive generation and hallucinations, the framework introduces Repetition-Aware Distillation, pairing repetition masking with unlikelihood regularization. Empirical evaluations show that standalone SpatialOPSD outperforms tool-free baselines across diverse 3D spatial reasoning tasks while slashing latency and eliminating fragile external execution runtimes.

Zoom

Interactive virtual environments allow embodied AI agents to learn through exploration and practice, but creating worlds that are simultaneously faithful (rigid state dynamics and programmatic rules) and realistic (photorealistic visual distributions) has remained a critical bottleneck: physics engines lack visual fidelity, whereas generative video models suffer from compounding visual hallucinations during extended agent interactions. MirroS Lab and researchers introduce AgentGarten (arXiv:2610.12374, repo: github.com/MirroS-Lab/AgentGarten, site: mirros-lab.github.io/agent-garten), an open-source framework that decouples physics simulation backends from a shared neural renderer. Simulators maintain ground-truth state and execute code-defined rules without ingesting rendered frames, strictly preventing error accumulation. Visual observations are synthesized in real-time (>30 FPS) from exported geometric conditions via a neural renderer trained with Adversarial Forcing, making history prefilling differentiable through exact replay. Agents learn through visual perception, distilling execution trajectories into playbooks that succeeding generations inherit. In benchmarks such as hide-and-seek, agents autonomously discover obstacle-moving and ramp-climbing tactics in just 4 to 10 rounds (compared to tens of millions of rounds in classic RL), with code and environments fully open-sourced.

Zoom

Humans solve complex spatial transformations by mentally simulating physical visual transitions, maintaining visual imaginations to ground multi-step reasoning. In contrast, existing Vision-Language Models (VLMs) tackle spatial questions almost entirely via text-token chains of thought, triggering acute hallucinations when predicting 3D rotations or spatial clearances. Researchers from Carnegie Mellon University and MBZUAI introduce WM-VLM (arXiv:2609.34826), integrating a lightweight world model branch directly into foundation VLMs to synthesize intermediate visual states during inference. The framework adopts a two-stage training paradigm: first training the model to foresee and render verifiable intermediate visual states, and then training it to ground downstream logical deductions upon those synthesized states. Evaluated on rigorous 2D and 3D mental rotation tasks, WM-VLM outperforms standard SFT baselines by up to 39.25 percentage points. Ablations prove that performance collapses when generated visual frames are removed or corrupted, establishing that internal world models provide indispensable spatial cognitive scaffolds.

Zoom

Self-evolving search agents construct synthetic training curricula by jointly co-optimizing a question proposer and an answer solver. However, this closed loop frequently triggers a deceptive failure mode termed 'co-cheating': the proposer and solver increasingly converge on shared hallucinations, artificially driving up internal training rewards while external factual correctness degrades. The acclaimed research 'False Frontiers' (arXiv:2609.39102, 330+ upvotes on Hugging Face) diagnoses this structural blind spot and introduces CrossFit. By partitioning source documents into orthogonal subsets and scoring proposals with solvers trained exclusively on complementary splits, CrossFit severs the circular pseudo-label reinforcement loop. Evaluated across seven downstream search benchmarks, CrossFit elevates average scores by 8.8 and 8.4 points on 4B and 9B models, systematically outperforming Search-R1.

Zoom

Self-evolving search agents jointly optimize a question proposer and an answer solver to generate synthetic training curricula. However, False Frontiers exposes a critical failure mode: 'co-cheating', where proposer and solver agree on shared hallucinations and erroneous pseudo-labels, causing internal rewards to surge while real external accuracy collapses. The authors introduce CrossFit, which partitions source corpora into disjoint splits and scores proposals via cross-trained solvers. Evaluated on Qwen3.5-4B/9B across 7 downstream search benchmarks, CrossFit suppresses false agreement down to 3.7% and outperforms coupled self-evolution by 8.8 points and Search-R1 by 8.7 points.

Zoom

Safety researchers have introduced 'Just Ask Jev' alongside the RLCDAlignBench suite (arXiv: 2609.29429, GitHub: sumleo/RLCDAlignBench). Conventional alignment auditors rely on expensive generative LLM judges or rigid single-label classifiers (e.g., Llama Guard). Trained via Reinforcement Learning for Calibrated Decisions (RLCD), Jev evaluates multiple typed alignment questions simultaneously across ten failure modes—sycophancy, jailbreaks, deception, prompt injection, hallucination, privacy breaches, bias, reward hacking, uncertainty concealment, and power seeking—in a single forward pass. Achieving a median 0.886 zero-shot AUROC across 44 benchmarks, Jev matches human consensus while slashing evaluation costs by 63x.

Zoom

Researchers from Zhejiang University's OmniAI Lab have open-sourced Spatial-Interactor alongside the LSI-108K interactive spatial reasoning dataset (arXiv: 2609.23038). Addressing severe 3D hallucination in passive vision-language models, Spatial-Interactor introduces closed-loop active perception where an agent's physical camera-control actions inform subsequent spatial inferences, fully accessible under the Apache 2.0 license.

Zoom