AI Coding Live News

On Nov 2, semiconductor and AI research firm SemiAnalysis released GDPx, a benchmark of agentic capability across 11 domains: chip design, cybersecurity, biology, finance, legal, quant trading, recursive self-improvement (RSI), hardware design, materials science, alignment and software engineering. Its 206 tasks were built by 14 specialist data partners, with SemiAnalysis doing final QA. On the official leaderboard Claude Opus 5.5 leads at 12.0%, followed by Gemini 4 Carbon at 10.9% and GPT-6 Astra at 9.6%; nearly every model scores 0 on finance and legal. SemiAnalysis says safety classifiers drag down Opus 5.5 and GPT-6 Astra, and plans a new version every 3–6 months. All scores are as reported by SemiAnalysis.

Zoom

The Shanghai Artificial Intelligence Laboratory published the technical report for Sage-A1.5 on arXiv:2610.28578, introducing an open-weights 35B Mixture-of-Experts (MoE) foundation model purpose-built for agentic tasks. Building on the Agents-A1 lineage, Sage-A1.5 focuses on scaling the agent execution horizon rather than model parameters through adaptive capability composition. Tailored for complex repository-level software engineering and multi-step scientific hypothesis exploration, Sage-A1.5 consistently outperforms dense 70B+ baselines on long-horizon reasoning benchmarks while maintaining lightweight deployment footprints.

Zoom

Training and evaluating frontier coding agents is bottlenecked by the finite supply and high curation cost of real-world software engineering (SWE) issues. Researchers from Shanghai Jiao Tong University introduce SWE-at-Scale, which reverse-engineers historical bug fixes into mechanistic bug-induction supervision and transfers those learned failure patterns to novel code contexts. SWE-at-Scale robustly synthesizes up to 200 distinct, realistic executable bug types from a single file context.

Zoom

On 2026-10-15 StepFun released open weights for Step 5 Preview as promised: a 600B-total / 27B-active sparse MoE with up to 1M-token context and vision input, aimed at agentic software engineering and knowledge work. Checkpoints are on Hugging Face (FP8, BF16, NVFP4) and ModelScope. Official scores include StepCodeBench 49.0%, FrontierFinance 66.4%, and Artificial Analysis Intelligence Index 44. September coverage was API/index only; this is the first public weight drop.

Zoom

As software engineering shifts toward autonomous coding agents, delegating the creation of specialized agents is becoming routine. The AgentSWE benchmark establishes the first systematic evaluation of agent software engineering across three lifecycle stages: Creation, Editing, and Optimization. Findings reveal a pronounced gap between prototype demonstration and held-out test acceptance across leading frontier models.

Zoom

Current software engineering benchmarks and training pipelines predominantly evaluate coding agents on localized bug fixing within existing repositories (such as SWE-bench) or isolated code snippet generation. They fail to teach agents how to explore unfamiliar reference systems, formulate architectural blueprints, and reproduce complete, multi-file software projects from scratch under long-horizon constraints. Researchers introduce ProgramGym (arXiv:2610.13395, repo: github.com/Acm1011/ProgramGym, dataset: ProgramGym/programgym-1648), an automated framework scaling verifiable training environments for program reproduction agents. ProgramGym consists of Program-Env, a feedback-driven engine that converts open-source repositories into verified runtime sandboxes paired with black-box test suites across C, C++, Go, and Rust (generating ProgramGym-1648), alongside Program-Agent, an iterative workflow enforcing role isolation across Analysis, Implementation, and Review stages with revision management. Fine-tuning Qwen3.8-27B on ProgramGym trajectories raises ProgramBench test pass rates from 34.87% to 42.84% (+7.97 points), outperforming GPT-5.4 under mini-SWE-agent (37.70%). Coupling SFT with the Program-Agent scaffold boosts performance to 56.25%, eclipsing Claude Opus 4.7 (50.90%) and Gemini 3.5 Flash (53.60%), with datasets and codebase open-sourced.

Zoom

As autonomous software engineering agents and command-line assistants evolve from single-turn tool invocation toward complex, multi-stage delivery, the scarcity of high-quality, long-horizon terminal interaction data has emerged as a fundamental bottleneck. Researchers from USTC, Alibaba Group (AMAP), and SUSTech introduce TerminalHorizon (arXiv:2610.13166), a fully automated data synthesis engine for training long-horizon terminal agents. Addressing standard pitfalls where synthetic environments oversimplify core challenges and eliminate the need for exploration, TerminalHorizon extracts workflows from real-world tasks, pinpoints omitted steps through independent execution loops, dynamically reconstructs environments based on observed evidence, and organically scales task complexity across multiple stages under unified objectives. Synthesizing 1.5K environments and 2,852 trajectories averaging 52.8 turns, the authors train TerminalHorizon-27B (fine-tuned on Qwen3.5-27B). The model achieves 55.8% on Terminal-Bench 2.0 (+14.2 points over base Qwen3.5-27B), sweeping 12 benchmarks across coding agents, production environments, and reasoning with project datasets open-sourced.

Zoom

As autonomous coding agents undertake multi-hour, long-horizon software engineering tasks, humans transition from granular copilots to high-level overseers. However, auditing agents across thousands of shell executions and fragmented code edits creates severe cognitive overload: overseers struggle to locate decisive actions and identify consequential decisions requiring human verification. Researchers introduce AgentMonBench and the Evidence-Grounded Behavior Graph (EBG) framework (arXiv:2610.06406, code: github.com/zhk-lab/EBG, site: zhk-lab.github.io/agentmonbench-ebg). AgentMonBench assesses oversight monitors across requirement alignment and decision risk awareness. EBG is a training-free methodology that structures source-linked execution evidence into semantic behaviors, assembling their dependencies into a directed causal behavior graph with task-oriented views. Tested across eight foundation models, EBG consistently outperforms raw-context baselines in identifying consequential decisions and localizing supporting evidence across varied trajectory scales, with code and datasets fully open-sourced.

Zoom

In software engineering and knowledge-work tasks, autonomous coding agents operate via Direct Workspace Interaction (DWI)—issuing shell commands to navigate, inspect, and modify files within local repositories without external vector indexing. However, during extended interaction horizons, agents suffer severe context degradation: initial task requirements are purged from context windows by voluminous file dumps, read file provenances vanish, and listed but unopened candidate files are permanently forgotten, leading to premature task terminations and unfulfilled requirements. Researchers from KAIST introduce RunningTab (arXiv:2610.10444), an innovative agent interaction framework that replaces unreliable internal agent scratchpads with an environment-maintained 'running tab'. The tab persists three critical streams: dynamic requirement trackers, verified file excerpts with provenance links, and unopened candidate file stacks. When an agent attempts to finalize a deliverable, the environment triggers a mandatory 'Finish Check' barrier that blocks completion if unsatisfied criteria persist. Evaluated across Workspace-Bench, TheAgentCompany, and OfficeQA Pro benchmarks using frontier LLMs, RunningTab decisively outperforms vanilla DWI and self-refine baselines, establishing substantial gains in rubric satisfaction (TCR@70).

Zoom

Terminal coding agents are expanding from standard software engineering into scientific domains like bioinformatics, materials science, and physics. However, building training sandboxes requires executable reference behavior and rigorous verifiers capable of distinguishing true semantic correctness from superficial syntactic mimicry—a process that currently requires tedious manual engineering per task. Researchers from Tsinghua University and Tencent introduce Software-in-the-Loop Reconstruction (SWR, arXiv:2610.02710), a self-supervised environment scaling framework. SWR extracts ground-truth outputs and verifiers from existing executable scientific software workflows by perturbing input configurations into public observations and hidden evaluations. Agents synthesize complete, editable programs from input-output schemas without viewing source code, evaluated by hierarchical verifiers testing semantic fidelity, structural integrity, and anti-shortcut compliance. Implemented across 500 workflows and 46 software suites spanning six scientific domains, SWR generates 1,422 verified trajectories. Supervised fine-tuning of Qwen3.8-27B elevates Terminal-Bench 2 average success from 47.94% to 53.56%, establishing a scalable paradigm for scientific terminal agent training.

Zoom

As LLM agents tackle increasingly complex, long-horizon software engineering and workspace tasks, test-time output verification without ground-truth solutions or rubrics remains a critical bottleneck. Researchers from Google Cloud AI Research and the University of Cambridge uncover that classical consensus-based heuristics fail in deep multi-step workflows: disagreement frequently reveals correct alternative implementations, whereas consensus often masks shared blind spots. Motivated by this, they introduce VeriHarness (arXiv:2610.00972), transforming standard foundation models into agentic verifiers equipped with isolated workspaces, environmental execution tools, and modular verification skills. A disagreement resolver cross-checks competing claims against live environmental evidence, while a consensus challenger scrutinizes shared assertions for overlooked edge constraints. Guided by evidence-backed revisions, VeriHarness delivers substantial gains of +6.2 points on Gemini 3.5 Flash and +6.4 points on Claude Opus 4.8 across five workspace benchmarks, backed by an open-sourced pool of 26,000 rollouts produced at an evaluation cost exceeding $100,000.

Zoom

Modern software engineering transcends isolated code edits: engineers run applications, interact with GUI interfaces, and visually inspect rendering feedback to diagnose errors and verify changes. CUA-SWE bridges coding agents and computer-use agents by introducing the first unified benchmark and environment for visual software engineering. Spanning four engineering domains, CUA-SWE challenges agents to interleave code/config modifications, terminal execution, GUI interactions, and screenshot inspections, with deterministic test suites evaluating behavioral correctness.

Zoom