AI Coding Live News

On November 3, OpenAI published "Accelerating engineering for the physical world," describing how its models help with mechanical design, electrical design and simulation. Two employees used GPT-6 Astra to design a device for talking to Codex (enclosure, PCB, firmware and software) in under a week, and a contract manufacturer built a small prototype batch in under a month, though manufacturing readiness still took several rounds of human review. Token usage across OpenAI hardware teams has grown 23-fold since February. On BenchCAD 2.0, a newer internal model averaged 0.875 versus 0.594 for GPT-6 Astra at its highest reasoning setting (OpenAI-reported). OpenAI is also expanding its work with Chip Ganassi Racing and announced a new research collaboration with Mazda.

Zoom

Microsoft Research (MSRA) researchers published and open-sourced WildAWM (arXiv:2610.26828, GitHub: MSR-Orchard/WildAWM), a generalist agent world model designed for open-ended 'in the wild' digital environments. Traditional computer-use agents rely on slow, brittle, and expensive live web/OS sandboxes for training and evaluation. WildAWM establishes a scalable multimodal world model that accurately predicts visual screen transitions and DOM mutations conditioned on agent actions (click, type, scroll). By replacing live execution environments with a high-fidelity neural simulator, WildAWM unlocks safe, accelerated offline reinforcement learning for GUI agents.

Zoom

At GTC Berlin, Mistral AI and NVIDIA announced a strategic partnership dedicated to advancing AI for industrial engineering, computational physics, and electronic design automation (EDA). The alliance couples Mistral frontier architectures with NVIDIA CUDA-X libraries, Warp physics simulation frameworks, and Omniverse digital twins. Mistral simultaneously revealed architectural specifics for its forthcoming flagship, Mistral Large 4: spanning roughly 1 trillion total parameters with 49 billion active parameters (MoE), trained on 3,800 Grace Blackwell GPUs, with open weights slated for official release at the end of October 2026.

Zoom

On October 19 Dream Labs came out of stealth with a $90M seed round and opened a public API for Dream-1. Dream-1 is a World Action Model (WAM) that learns to predict video and actions together. The company says it can zero-shot control bimanual parallel-gripper robots without any demonstrations from that robot, and it ran 27 unseen robots in simulation, including the 18-year-old PR2. Pricing is $3/hour for Dream-1 and $2/hour for Dream-1-flash. In an independent Robocurve evaluation, Dream-1 scored 59 on RoboDojo-RC Tier 1 versus 48 for the previous best. The company stresses it is a research beta not validated for safety-critical use.

Zoom

Three new open-source embodied AI frameworks overcome observation-action overfitting in Vision-Language-Action (VLA) policies: Zhejiang University's 2B VLA-Δ (arXiv:2610.21306, 54 upvotes) supervises explicit physical state transitions with zero inference overhead to set a 98.4% SOTA on LIBERO; SJTU and HKU's OneWM (arXiv:2610.21095, 40 upvotes) unifies causal world and action modeling to reach 36.68% on RoboCasa365 (over 2x π0.5 at 16.90%); and UIUC/Amazon's CoDA (arXiv:2610.22362) co-evolves simulation data engines and action policies via Text2potential shaping, raising LIBERO-Pro success from 25% to 84% under position perturbations and from 1% to 76% under instruction perturbations.

Zoom

Anthropic published STEM Fellows research on Oct 16: given plain-language specs plus an automated evaluator that verifies correctness and scores qubits x gates, Claude Mythos 5 found quantum-circuit designs that beat the best published ones across eight primitives in chemistry, optimization, simulation and number theory. On elliptic-curve point addition it worked 53 hours with minimal human input and produced the first reversible divsteps modular inversion with no stored branch history; for decoded quantum interferometry it cut Reed-Solomon decoder gates about 12x versus Google's prior construction. Paper: arXiv 2610.22367.

Zoom

Reconstructing scene-aligned, high-fidelity 3D assets from casual photos is foundational for robotics and spatial computing. However, casual captures suffer from sparse viewpoints, optical blur, and severe occlusions, causing standard 3D diffusion models to produce warped unobserved backsides and incorrect 6-DoF poses. NVIDIA Research introduces GATOR (arXiv:2610.11215, project: research.nvidia.com/labs/lpr/gator), a generative and agentic framework that reconstructs complete textured 3D objects and their scene-relative poses from one or more casual images. GATOR couples patch-aligned RGB, target masks, and pointmap features through a local modality mixer, synthesizing initial textured geometry via stage-specific adapters. Crucially, the generated asset initializes a multimodal agent that iteratively inspects, refines, and aligns the asset through an observation-guided edit-render-review loop. Across synthetic benchmarks, cluttered tabletops, and real indoor scenes, GATOR achieves state-of-the-art geometric fidelity and instant simulation readiness with superior inference efficiency.

Zoom

Interactive virtual environments allow embodied AI agents to learn through exploration and practice, but creating worlds that are simultaneously faithful (rigid state dynamics and programmatic rules) and realistic (photorealistic visual distributions) has remained a critical bottleneck: physics engines lack visual fidelity, whereas generative video models suffer from compounding visual hallucinations during extended agent interactions. MirroS Lab and researchers introduce AgentGarten (arXiv:2610.12374, repo: github.com/MirroS-Lab/AgentGarten, site: mirros-lab.github.io/agent-garten), an open-source framework that decouples physics simulation backends from a shared neural renderer. Simulators maintain ground-truth state and execute code-defined rules without ingesting rendered frames, strictly preventing error accumulation. Visual observations are synthesized in real-time (>30 FPS) from exported geometric conditions via a neural renderer trained with Adversarial Forcing, making history prefilling differentiable through exact replay. Agents learn through visual perception, distilling execution trajectories into playbooks that succeeding generations inherit. In benchmarks such as hide-and-seek, agents autonomously discover obstacle-moving and ramp-climbing tactics in just 4 to 10 rounds (compared to tens of millions of rounds in classic RL), with code and environments fully open-sourced.

Zoom

Humans solve complex spatial transformations by mentally simulating physical visual transitions, maintaining visual imaginations to ground multi-step reasoning. In contrast, existing Vision-Language Models (VLMs) tackle spatial questions almost entirely via text-token chains of thought, triggering acute hallucinations when predicting 3D rotations or spatial clearances. Researchers from Carnegie Mellon University and MBZUAI introduce WM-VLM (arXiv:2609.34826), integrating a lightweight world model branch directly into foundation VLMs to synthesize intermediate visual states during inference. The framework adopts a two-stage training paradigm: first training the model to foresee and render verifiable intermediate visual states, and then training it to ground downstream logical deductions upon those synthesized states. Evaluated on rigorous 2D and 3D mental rotation tasks, WM-VLM outperforms standard SFT baselines by up to 39.25 percentage points. Ablations prove that performance collapses when generated visual frames are removed or corrupted, establishing that internal world models provide indispensable spatial cognitive scaffolds.

Zoom