AI Coding Live News

Tracing the Thoughts of a Coding Agent Playing ARC-AGI-3: White-Box Lessons for Continual Learning

Continual learning without weight fine-tuning represents a frontier in LLM agent research. When an agent acts purely by writing and executing Python scripts inside an execution sandbox, every thought, hypothesis, and plan leaves a verifiable trace on disk. In a newly released study (arXiv:2610.11450), researchers subject coding agents to ARC-AGI-3—a suite of instruction-free abstract visual reasoning environments where each sequential level introduces novel causal dynamics. Developing a fine-grained measurement protocol, the authors trace thoughts across file artifacts across seven full evaluation runs spanning three foundation backbones from two major model families. The empirical findings reveal that scripts written for one level are almost never invoked in subsequent levels (only 33 of 630 cross-task references survive), as agents deliberately abandon 74% of scripts at task boundaries to purge level-specific overfitted state while rewriting core rules. Notes are maintained in an append-only fashion, with conflicting claims arbitrated against raw execution logs to achieve selective rather than catastrophic forgetting. Crucially, the study identifies carrying hard-coded variables across task boundaries as the single most devastating failure mode of autonomous agents.

Key Takeaways

  • Presents the first white-box thought-tracing audit of coding agents continually learning across ARC-AGI-3 environments
  • Finds agents deliberately abandon 74% of scripts at task shifts to purge state, settling append-only notes against immutable logs
  • Identifies carrying hard-coded constants across task boundaries as the single most catastrophic agent failure mode
Read full story
Linked Models & Agents:
⚡ ARC-AGI-3⚡ Coding-Agent⚡ Continual-Learning🤖 ARC-Agent🤖 Thought-Tracer🌐 Hugging Face🌐 Open Source Research

Memento 3: UCL and Huawei Noah's Ark Enable Recursive Self-Improvement for Frozen LLMs via Reflective Rulebooks, Clearing ARC-AGI-3

Endowing artificial agents with general intelligence requires inferring environment dynamics and refining world models continuously in the wild. Fine-tuning models directly is prohibitively expensive and precipitates catastrophic forgetting. Researchers from University College London (UCL) and Huawei Noah's Ark Lab UK present Memento 3 (arXiv:2610.11794), a framework enabling frozen LLM agents to achieve model-based Recursive Self-Improvement (RSI) purely via external memory. The agent maintains a natural-language rulebook representing its evolving hypotheses of environment physics, which is compiled into executable code for fast simulation and action planning. Governed by a continuous observation-reflection-revision-compilation-verification loop, the system leverages prediction errors to refine rules. Edits are merged only after passing LLM semantic alignment audits and deterministic cell-exact replay verification. On the rigorous ARC-AGI-3 abstraction benchmark, Memento 3 solves 100% of levels across all 25 public environments, scoring a perfect 100.0 Relative Human Action Efficiency (RHAE) while utilizing only 44% of human action counts. In Atari Pong, a synthesized feedback controller shuts out opponents 21:0 across three evaluation seeds with zero test-time LLM inference.

Key Takeaways

  • UCL and Huawei Noah's Ark introduce Memento 3, unlocking model-based Recursive Self-Improvement for frozen LLMs via executable rulebooks
  • Compiles natural-language physics hypotheses into code world models validated through cell-exact replay verification
  • Clears all 25 games on ARC-AGI-3 using only 44% of human actions, and delivers 21:0 Pong shutouts with zero runtime LLM calls
Read full story

OpenAI Launches GPT-6 Astra, a SOTA Computer-Use Model

OpenAI launched GPT-6 Astra, calling it the world's most intelligent and aligned model, able to perform nearly any computer task for the user. It sets new state of the art on FrontierMath Tier 4, ARC-AGI 3, and TerminalBench-4.0, with major gains in software engineering, cybersecurity, science, and professional workflows. It is now live for Pro, Enterprise, Business, and API customers, with Plus rollout underway.

Key Takeaways

  • Sets SOTA on computer use, browsing, software engineering, and science benchmarks
  • Live in ChatGPT Work, Codex, the OpenAI API, and AWS
  • Plus and Business access is rolling out over the coming days
Read full story

ARC Prize: GPT-6 Astra SOTA on ARC-AGI-3 — 62.7% standard, 99.9% with Provider Adapter

ARC Prize measured OpenAI GPT-6 Astra on ARC-AGI-3 Semi-Private: about 62.7% for ~$26k with the Standard harness and 99.9% for ~$19k with a Provider Adapter harness that preserves opaque reasoning state. Astra beat the human action-efficiency baseline on 96% of levels and built custom algebraic notes and tools.

Key Takeaways

  • Standard harness: ~62.7% / ~$26k on ARC-AGI-3 Semi-Private under a provider-neutral interface.
  • Provider Adapter: keeps opaque reasoning state and compaction — ~99.9%, ~49% fewer tokens.
  • Action efficiency: fewer actions than the human median on 96% of levels; builds custom notation and game-specific tools.
Read full story
Linked Models & Agents:
ADSponsored

OpenAI: GPT-6 Astra SOTA on Agents’ Last Exam, AutomationBench, and ScreenSpot Pro

OpenAI says GPT-6 Astra is state-of-the-art on Agents’ Last Exam, AutomationBench, and ScreenSpot Pro—benchmarks for cross-profession computer workflows and screen grounding—adding computer-use evidence beyond the already announced TerminalBench / ARC-AGI / FrontierMath results.

Key Takeaways

  • Claims SOTA on Agents’ Last Exam, AutomationBench, and ScreenSpot Pro for computer workflows/screen ops.
  • Framed as cross-profession computer use, not just repo-fix coding.
  • Complements already-announced TerminalBench / ARC-AGI / FrontierMath agentic evidence.
Read full story
Linked Models & Agents:

OpenAI: GPT-6 Astra SOTA on FrontierMath, ARC-AGI 3, and TerminalBench-4.0

OpenAI says GPT-6 Astra is state-of-the-art on FrontierMath Tier 4, ARC-AGI 3, and TerminalBench-4.0, and also leads on Terminal-Bench Science 0.1 and HealthBench Pro—highlighting agentic terminal and scientific discovery strength.

Key Takeaways

  • Claims SOTA on FrontierMath Tier 4, ARC-AGI 3, and TerminalBench-4.0.
  • Science side: also claims lead on Terminal-Bench Science 0.1 and HealthBench Pro.
  • Companion to the launch post, framing coding/terminal-agent and research workflows.
Read full story
Linked Models & Agents: