AI Coding Live News

Vercel Labs launches agent-desktop: computer use for any coding agent via OS accessibility trees, not pixels, on macOS, Windows and Linux

On October 31, Chris Tate of Vercel Labs, creator of agent-browser, announced agent-desktop on X as "agent-browser, for your whole computer". It is an Apache-2.0 Rust CLI and C library that reads a desktop app's OS accessibility tree and returns every actionable element as a JSON ref; the agent clicks or types on a ref and snapshots again to verify, with no pixel matching, headless by default. Version 1.0.0 shipped on October 27 and added Linux support; the current npm release is 1.0.2.

Vercel Labs launches agent-desktop: computer use for any coding agent via OS accessibility trees, not pixels, on macOS, Windows and Linux

Key Takeaways

  • Install: npm install -g agent-desktop, one package with native x64/ARM64 binaries; 1.0.0 (Oct 27) added Linux (glibc 2.35+, via AT-SPI), and the latest npm release is 1.0.2 (Oct 30)
  • Loop: snapshot prints a JSON tree with refs, click @<snapshot_id>:eN acts, then snapshot again to verify; a changed UI returns STALE_REF, and errors say whether a retry is safe
  • Scope: the README lists 60 command names, 56 of them operational, spanning windows, keyboard and mouse, notifications, clipboard, waits and session traces
  • Headless by default: ref actions go through accessibility APIs without moving the pointer or stealing focus, with --headed for physical input; Chris Tate says multiple agents can use the computer in parallel, each with its own cursor
  • Benchmarks: no official success-rate or speed numbers; it is a tool with no model inside, and web pages stay with agent-browser
Read full story

X discussion: Anthropic's head of platform engineering says a team with no Rust developers had Claude port the whole Messages API to Rust, cutting CPU by roughly 40-50%

Katelyn Lesse, Anthropic's head of platform engineering, said on the Latent Space podcast (published Oct 27) that a Rust version of the Messages API fully rolled out the previous week. The old system was a CPU-hungry Python monolith, the team started with "not a single Rust developer", humans designed and verified the system, Claude wrote the implementation, and shadow traffic compared outputs between the old and new versions. Her ballpark figures are roughly 40-50% less CPU and 10-20% better time to first token. A clip posted by Somi (@somi_ai) drew 1,000+ likes and about 140K views on X and was quoted by swyx and others, with the debate centered on whether "never do the big rewrite" is now outdated advice. These are X discussion views and spoken estimates; Anthropic has not published a written engineering report.

X discussion: Anthropic's head of platform engineering says a team with no Rust developers had Claude port the whole Messages API to Rust, cutting CPU by roughly 40-50%

Key Takeaways

  • The first-hand source is Katelyn Lesse speaking on the Latent Space episode "How Anthropic ships Claude with Claude", in the "56:05 Rebuilding the Messages API in Rust" segment
  • Lesse said the move was driven by CPU becoming a bottleneck as usage surged; CPU now has to be capacity-planned in advance, and research sandboxes, product sandboxes and CI all draw from the same pool inside Anthropic
  • The team forked the entire API in Rust in one go, ran shadow traffic to confirm the Python and Rust outputs matched, then turned it on gradually, deliberately adding no new features during the port
  • Her ballpark is about 40-50% CPU savings and 10-20% better time to first token, with larger gains on longer-running workloads; these are spoken estimates from the podcast, not a formal benchmark
  • On X, Somi called "never do the big rewrite" dead advice and swyx said Anthropic "vibecoded their entire backend to Rust"; the latter is an exaggeration, since Lesse only discussed the Messages API
Read full story
Linked Models & Agents:

OpenAI says Daybreak Blue sessions on personal accounts may be used for training even with the training toggle off, drawing security researcher backlash on X

OpenAI's "Data controls in ChatGPT" Help Center page now has a "Trusted Access on personal accounts" section: during sessions in Trusted Access programs such as Daybreak Blue, OpenAI may use interaction content to improve its models even when "Improve the model for everyone" is off, to strengthen safeguards against cyber misuse, while other activity still follows the user's setting. Emails that several users shared on X say the change takes effect November 29, and researchers including Sean Heelan criticized it for pulling unreported vulnerabilities and research into training data.

Key Takeaways

  • Official wording: Trusted Access sessions such as Daybreak Blue on personal accounts may be used to improve models regardless of the "Improve the model for everyone" toggle
  • The exception covers only Trusted Access sessions; other chats on the account still follow the existing setting
  • Managed workspaces such as Business and Enterprise, and the API, are still not used for training by default
  • Emails users shared on X say it takes effect November 29, and some users say individuals lose Daybreak Blue API access on November 20 (the official pages do not state either date yet)
  • Sean Heelan's critical post drew 600+ likes and 100+ reposts, and several bug bounty hunters said they would reconsider using the program
Read full story
O
OpenAI@AICoder·
👀29
🔥80

OpenAI Codex CLI 0.166.0: keyboard transcript selection, GPT-6.1 Terra in Vertex AI and Bedrock catalogs, codex doctor network checks

OpenAI published the stable Codex CLI release rust-v0.166.0 on GitHub at 19:47 UTC on Oct 29. It adds keyboard-driven transcript selection by word, line and page with built-in search, adds GPT-6.1 Terra to the bundled, Vertex AI and Amazon Bedrock model catalogs, introduces codex queue --resume and codex doctor --network-only, and shows clearer safety-block explanations with selectable safer follow-up prompts in the TUI.

Key Takeaways

  • Model catalogs: GPT-6.1 Terra added to the bundled, Vertex AI and Amazon Bedrock catalogs (#57293)
  • Transcript: keyboard selection by word, line and page, integrated search and configurable shortcuts (#57221 to #57224)
  • New commands: codex queue --resume resumes unloaded threads after queueing a message; codex doctor --network-only checks config, connectivity and WebSocket
  • Safety UX: clearer explanations when a request is blocked, plus selectable safer follow-up prompts (#57363, #57365)
  • Fixes: approval and permission settings survive resume and fork, and reasoning-token accounting is preserved to avoid premature compaction
Read full story
ADSponsored

Google DeepMind unveils Genie 4 world model: built on Gemini Omni, first with native real-time audio and dialogue, in research preview for trusted testers

Google DeepMind announced Genie 4 on Oct 27, calling it its most realistic and interactive world model yet. Built on Gemini Omni, it improves physics and human motion, natively generates ambient audio and interactive character dialogue for the first time, and uses Gemini 3.8 Flash in the loop to plan complex events. It is a research preview for trusted testers for now, coming soon to Google AI Ultra (Project Genie) and early access partners in the Gemini API and AI Studio; no quantitative benchmarks were published.

Google DeepMind unveils Genie 4 world model: built on Gemini Omni, first with native real-time audio and dialogue, in research preview for trusted testers

Key Takeaways

  • Per Google DeepMind, Genie 4 is its most realistic and interactive world model yet, with Gemini Omni anchoring real-world appearance and behavior
  • It is DeepMind's first real-time world model with native audio: ambient sound, music and character dialogue are generated with the world, and characters respond live
  • Gemini 3.8 Flash acts as a guiding agent in the loop, splitting goals into steps and checking frames; a demo pairs Gemini 4 Argon with Genie 4 to simulate an Apollo humanoid
  • Official limitations: only a few minutes of continuous interaction and drift over longer sessions; no quantitative benchmarks were published
  • Trusted testers only for now; coming soon to Google AI Ultra (Project Genie) and Gemini API / AI Studio early access partners, with SynthID on all outputs
Read full story
Linked Models & Agents:

X discussion: Matt Pocock sketches the ideal "language for agents" (Rust speed, Go-sized design space, strictest verification) and names Bend; Chris Lattner replies with Mojo

At 17:23 UTC on 2026-10-25, TypeScript educator Matt Pocock (@mattpocockuk, author of Total TypeScript and AI Hero) posted (post) that the next great "language for agents" should be as fast as Rust, have as little design space as Go, and have the strictest type/verification system ever written, calling Bend "an interesting first effort". When we pulled it, the post had about 3,130 likes, 84 reposts, 264 replies, 786 bookmarks and 220K views, and it reached X's trending stories. Mojo creator Chris Lattner replied (reply) recommending Mojo and suggesting "can target all hardware" be added to the list. This is an opinion debate, not a verified conclusion.

Key Takeaways

  • Main post: post, published 17:23 UTC on 10-25, with about 3,130 likes, 84 reposts, 264 replies, 786 bookmarks and 220K views when we pulled it
  • Three criteria: Rust-level speed, a Go-sized design space (few ways to write the same thing), and the strictest type/verification system ever written, so the compiler rather than a human catches agent mistakes
  • Chris Lattner replied recommending Mojo, citing advanced type features such as linear types and symbolic constraints, and suggested adding "can target all hardware" (reply, about 40 likes when pulled)
  • Bend creator Victor Taelin (@VictorTaelin) also joined the thread, saying Bend blocking an agent from breaking an app is "working as intended"
  • No benchmarks or controlled comparisons were shared; whether Bend or Mojo suits agent coding remains personal opinion
Read full story
Linked Models & Agents:

NVIDIA Unveils OpenShell Reference Architecture: Hardware-Isolated Security Guardrails for Autonomous Agents

At GTC Berlin, NVIDIA unveiled the OpenShell Reference Architecture alongside the Agent Knowledge Foundation within its Agent Toolkit. Addressing critical enterprise vulnerabilities where autonomous tool-using agents succumb to prompt injections, hallucinated destructive commands, or unauthorized data exfiltration, OpenShell establishes hardware-isolated runtime boundaries. Operating through hardware roots of trust, OpenShell dynamically intercepts out-of-boundary tool calls and file access in real time with sub-microsecond latency, establishing an authoritative blueprint for secure, auditable enterprise agent deployments.

NVIDIA Unveils OpenShell Reference Architecture: Hardware-Isolated Security Guardrails for Autonomous Agents

Key Takeaways

  • NVIDIA officially launched the OpenShell Reference Architecture at GTC Berlin, establishing hardware-isolated boundaries for autonomous agents
  • Implements dynamic runtime interception, strictly preventing out-of-boundary tool invocations, malicious script execution, and data leaks
  • Natively integrates with the NVIDIA Agent Toolkit and Agent Knowledge Foundation for end-to-end access control and compliance auditing
  • Solves critical enterprise security roadblocks preventing production rollout of high-privilege coding and autonomous operations agents
Read full story
Linked Models & Agents:

OpenAI open-sources MultiLangBench and reports low-resource language gains: GPT-6 Astra averages 87.4% building SQLite across 20 languages, GPT-6.1 Sol reaches up to 97.9% on COBOL migration

On October 19 OpenAI said its latest models are much better at low-resource languages such as COBOL, Fortran, Visual Basic and OCaml, and open-sourced MultiLangBench, which asks a model to build a SQLite-compatible database engine from scratch in each of 20 languages. GPT-6 Astra averages an 87.4% test pass rate (GPT-5.6 Sol: 26.8%), above 83% in 19 of 20 languages, with COBOL hardest at 72.1%. On a separate COBOL migration eval requiring byte-for-byte output parity after porting to C++, Java, Kotlin, Python or Rust, GPT-6.1 Sol scores 86.6% at low effort (GPT-5.6 Sol: 5.4%) and 97.9% at higher effort. All figures are OpenAI's own.

OpenAI open-sources MultiLangBench and reports low-resource language gains: GPT-6 Astra averages 87.4% building SQLite across 20 languages, GPT-6.1 Sol reaches up to 97.9% on COBOL migration

Key Takeaways

  • MultiLangBench: GPT-6 Astra (max) averages 87.4% across 20 languages vs 26.8% for GPT-5.6 Sol, above 83% in 19 of them (OpenAI-reported).
  • Per language: COBOL 10.9% to 72.1%, OCaml 25.6% to 85.8%, Fortran 21.4% to 83.5%, Visual Basic 27.5% to 89.4%.
  • Budget tier: GPT-6 Luna averages 40.3% at about $0.77 per sample vs $3.48 for GPT-5.6 Sol, roughly 78% cheaper.
  • COBOL migration: GPT-6.1 Sol scores 86.6% at low effort (GPT-5.6 Sol 5.4%) at about 61% of the API cost; 97.9% at higher effort, near saturation.
  • The eval setup, test suite and per-language results are on GitHub openai/multilangbench; the COBOL migration eval is not public.
Read full story

4.36x Faster World Model Attention with Zero Training: NUS Introduces Velox Spatial Memory, Alongside Nankai's DeltaStreamer and HKPolyU's CoWorld Reasoner

Four new studies advance interactive video world models and streaming video agents: NUS's training-free Velox router (arXiv:2610.22311) uses 3D camera frustum-slab correspondences on H200 GPUs to accelerate chunk-48 attention by 4.36x and denoising by 2.43x with negligible quality loss; Nankai University's DeltaStreamer (arXiv:2610.19849, 39 upvotes) combines change-aware memory with targeted frame replay to reach 66.07% on OVO-Bench; HKPolyU's CoWorld Reasoner (arXiv:2610.21910) co-evolves a VLM-VWM tool harness for +13.0% relative gains on ERQA; and Zhejiang University releases the 260-case WorldMemBench (arXiv:2610.19063).

4.36x Faster World Model Attention with Zero Training: NUS Introduces Velox Spatial Memory, Alongside Nankai's DeltaStreamer and HKPolyU's CoWorld Reasoner

Key Takeaways

  • NUS's training-free Velox router uses 3D camera frustum slabs on H200 to speed up chunk-48 attention by 4.36x and denoising by 2.43x within 0.15 points of dense attention on WBench
  • Nankai University's DeltaStreamer combines change-aware memory with targeted frame replay to achieve 66.07% on OVO-Bench and 59.53% on StreamingBench
  • HKPolyU's CoWorld Reasoner co-evolves a VLM-VWM imagination harness for +11.8% (MMSI) and +13.0% (ERQA) relative gains, alongside ZJU's 260-case WorldMemBench
Read full story
Linked Models & Agents:

Perplexity Open-Sources SPACE: Rust & Firecracker microVM Sandbox Platform Powering Perplexity Computer Under Apache 2.0

Perplexity has open-sourced SPACE (Sandboxed Platform for Agentic Code Execution) under the Apache 2.0 license—the core Rust-based sandbox infrastructure that executes every agent task in Perplexity Computer. SPACE provisions an isolated Firecracker microVM for each task while enforcing credential injection and outbound network traffic control strictly outside the VM boundary, surging past 1,100 GitHub stars within hours.

Perplexity Open-Sources SPACE: Rust & Firecracker microVM Sandbox Platform Powering Perplexity Computer Under Apache 2.0

Key Takeaways

  • Open-sourced under Apache 2.0: Perplexity releases SPACE, the Rust-based sandbox platform powering every task in Perplexity Computer (1,130+ GitHub stars)
  • Per-task Firecracker microVM isolation: provisions dedicated microVMs with pluggable runtime support for hardware-level tenant isolation
  • Out-of-VM credential & egress control: manages secrets and filters outbound traffic strictly outside the VM boundary to prevent prompt-injection exfiltration
Read full story
ADSponsored

Microsoft AI finishes pre-training MAI-Base-2: 2.8T-total / 80B-active MoE trained on 16K GB200s in 38 days, which MAI estimates is 4.2–12.3x more FLOPs-efficient than DeepSeek-V4-Pro-Base

On 2026-10-15 Microsoft AI published a technical post and PDF saying it has finished pre-training its in-house base model MAI-Base-2: MoE in every layer (1 shared + 7-of-512 routed experts), 80B active / 2.8T total, 102 layers, native encoder-free vision, a 50T-token mixture and a March 2026 knowledge cutoff. Per MAI, it beats every open-weight model tested on held-out BPB and its recipe is 4.2–12.3x more pre-training-FLOPs-efficient than DeepSeek-V4-Pro-Base. It is still in post-training: no API, no weights and no release date yet; Microsoft plans to license weights to trusted partners via Foundry.

Microsoft AI finishes pre-training MAI-Base-2: 2.8T-total / 80B-active MoE trained on 16K GB200s in 38 days, which MAI estimates is 4.2–12.3x more FLOPs-efficient than DeepSeek-V4-Pro-Base

Key Takeaways

  • Scale: 80B active / 2.8T total, 102 layers, hidden 8704, MoE in every layer (1 shared + 7 of 512 routed); MAI-Base-1 was 35B/1T, 78 layers, alternating dense/MoE (PDF)
  • Compute: 16K GB200s for 38 days (Aug–Sep 2026), 21% average MFU (vs 2.5 PFLOPS BF16), 89% goodput; the Muon step is 2.1% (165 ms) of iteration time
  • Efficiency (vendor estimate via scaling-law fits): 4.2–12.3x fewer FLOPs than DeepSeek-V4-Pro-Base to match its BPB; 6.3–12.7x better than the June MAI-Base-1 recipe
  • Data: 50T-token mixture, 18% vision-language (4.5T unique), ~36% more unique tokens than Base-1, described as organic data with no distillation
  • Availability: still in post-training, no API/weights/date; weights to be licensed to trusted partners through Foundry; MAI-Base-3 prep underway (blog)
Read full story
Linked Models & Agents:
⚡ MAI-Base-2⚡ MAI-Base-1⚡ MAI-Thinking-1⚡ DeepSeek-V4-Pro-Base⚡ Kimi K3⚡ Qwen3.8-2.4T-A95B🌐 Microsoft🌐 NVIDIA🌐 DeepSeek

Tesla Unveils Next-Gen Roadster Live at SpaceX McGregor: Fan Suction Inverted Driving, Mid-Air Flip over Semi, and 0–60 mph in 0.59s via Cold-Gas Thrusters

Nearly nine years after its 2017 concept reveal, Tesla hosted a live unveiling of the second-generation Roadster at SpaceX's McGregor rocket test facility in Texas. Using an active underbody fan suction system and SpaceX cold-gas thrusters fed by carbon-fiber COPV tanks, the prototype drove upside down on a curved ramp, executed a mid-air barrel roll recovery, and vaulted over a lineup of Tesla vehicles including a Semi truck. Offered in Performance (<1.6s, $50k deposit), Thrust (<0.9s, $250k deposit), and invite-only single-seat Rocket (<0.59s) trims, production is tentatively targeted for 2028.

Tesla Unveils Next-Gen Roadster Live at SpaceX McGregor: Fan Suction Inverted Driving, Mid-Air Flip over Semi, and 0–60 mph in 0.59s via Cold-Gas Thrusters

Key Takeaways

  • Live McGregor stunt demonstration: combines underbody vacuum fan suction for inverted ramp driving with a 260 kg compressed-air COPV and 10 nozzles for mid-air flip recovery and vaulting over a Tesla Semi
  • Three-tier lineup led by 0.59s Rocket trim: includes road-legal Performance (<1.6s, $50k deposit), rear-thruster Thrust (<0.9s, $250k deposit), and invite-only single-seat Rocket (<0.59s, >370 km/h)
  • Engineering reality & 2028 timeline: cold-gas thrusters deliver 4–5x tire grip limits for brief multi-second hops; Musk verbally targeted 2028 production while final retail pricing remains undisclosed
Read full story
Linked Models & Agents:
⚡ Tesla Roadster⚡ Roadster Rocket⚡ Roadster Thrust⚡ Roadster Performance🤖 SpaceX Flight Control🤖 Tesla Autonomy🌐 Tesla🌐 SpaceX

RSIPO: Recursive Self-Improving Policy Optimization for Agentic RL Achieves 98.6% Success on ALFWorld via Skill-Policy Co-Evolution

To improve credit assignment in long-horizon agentic tasks, combining reinforcement learning with verifiable rewards (RLVR) and on-policy self-distillation (OPSD) has emerged as a leading paradigm. However, existing pipelines neglect the dynamic evolution of agentic skills and the reliability of privileged teacher signals. Researchers from CUHK and Tencent introduced RSIPO, enabling skills and policies to co-evolve recursively. RSIPO extracts skills directly from trajectory rollouts, optimizes skill generation via replay, and employs Empirical Bayes shrinkage to calibrate student trust in teacher logits. Operating on Qwen2.5-7B, RSIPO achieves 98.6% success on ALFWorld, outperforming standard GRPO by 17.4 percentage points.

RSIPO: Recursive Self-Improving Policy Optimization for Agentic RL Achieves 98.6% Success on ALFWorld via Skill-Policy Co-Evolution

Key Takeaways

  • Co-evolution of skills and policies: the agent continuously extracts skills from executed trajectories, breaking the rigidity of static skill registries
  • Empirical Bayes shrinkage calibration: dynamically modulates student trust in teacher supervision, shielding the policy from noisy privileged guidance
  • State-of-the-art 98.6% on ALFWorld: delivers a 17.4 percentage-point improvement over standard GRPO on Qwen2.5-7B, excelling across embodied and search tasks
Read full story

ProgramGym Open-Sourced: Scaling 1,648 Verifiable Environments for Long-Horizon Program Reproduction Agents

Current software engineering benchmarks and training pipelines predominantly evaluate coding agents on localized bug fixing within existing repositories (such as SWE-bench) or isolated code snippet generation. They fail to teach agents how to explore unfamiliar reference systems, formulate architectural blueprints, and reproduce complete, multi-file software projects from scratch under long-horizon constraints. Researchers introduce ProgramGym (arXiv:2610.13395, repo: github.com/Acm1011/ProgramGym, dataset: ProgramGym/programgym-1648), an automated framework scaling verifiable training environments for program reproduction agents. ProgramGym consists of Program-Env, a feedback-driven engine that converts open-source repositories into verified runtime sandboxes paired with black-box test suites across C, C++, Go, and Rust (generating ProgramGym-1648), alongside Program-Agent, an iterative workflow enforcing role isolation across Analysis, Implementation, and Review stages with revision management. Fine-tuning Qwen3.8-27B on ProgramGym trajectories raises ProgramBench test pass rates from 34.87% to 42.84% (+7.97 points), outperforming GPT-5.4 under mini-SWE-agent (37.70%). Coupling SFT with the Program-Agent scaffold boosts performance to 56.25%, eclipsing Claude Opus 4.7 (50.90%) and Gemini 3.5 Flash (53.60%), with datasets and codebase open-sourced.

ProgramGym Open-Sourced: Scaling 1,648 Verifiable Environments for Long-Horizon Program Reproduction Agents

Key Takeaways

  • ProgramGym open-sources 1,648 verifiable multi-language environments for whole-program reproduction coding agents
  • Qwen3.8-27B-SFT achieves 42.84% on ProgramBench (+7.97 points), surpassing GPT-5.4 under mini-SWE-agent
  • Coupled with the Program-Agent scaffold, test pass rates reach 56.25%, outperforming Claude Opus 4.7 and Gemini 3.5 Flash
Read full story

Prime Intellect's Prime Agent used a 2,209-agent swarm to rewrite itself in Rust: time-to-type 738ms→56ms, 80%+ less memory

On Oct 9 Prime Intellect shipped a Rust rewrite of Prime Agent, its open-source coding agent harness. A root orchestrator ran 2,209 sub-agents across 10,000+ Prime Sandboxes and ~228.7B GLM-5.3 tokens over two weeks, with differential TUI, harness and protocol parity tests gating every merge. Vendor-measured cold time-to-type dropped from 737.8ms to 55.8ms and post-startup memory from 607MB to 106MB; Windows (beta) and Homebrew installs were added.

Prime Intellect's Prime Agent used a 2,209-agent swarm to rewrite itself in Rust: time-to-type 738ms→56ms, 80%+ less memory

Key Takeaways

  • Scale: 2,209 agents, 16,758 agent-to-agent messages, 228.70B tokens (192.99B/1,981 agents for the port, 35.70B/228 for perf hillclimbing) across 10,000+ Prime Sandboxes
  • Vendor-measured: cold time-to-type 737.8ms→55.8ms (13.22x), first paint 722.8ms→23.6ms, post-startup RSS 607.4MB→106.0MB, install 172.1MB→59.6MB
  • Each task ran a Planner→Implementer→adversarial Reviewer (different model)→Verifier state machine; failures loop back to the implementer
  • A 3-day target-free hillclimb loop logged 144+ experiment/audit records and merged 69+ performance changes
  • Codebase now 9 crates, largest file ~2,500 lines (was ~15,000); native Windows (beta) and Homebrew installs, still open source
Read full story