AI Coding Live News

Fireworks Forge Launches: Ultra-fast Inference Preview Hits 1,500 Tokens/s, Half-Price Background Mode, Nexus Desktop for Codex and Claude Desktop, Sovereign Private Preview

At its first Forge conference on November 3, open-model inference platform Fireworks launched a batch of products. Ultra-fast, powered by NVIDIA Blackwell, is in public preview at up to 1,500 tokens per second on DeepSeek V4.1 Flash, cutting a 30-turn agent task from 1 minute to 8 seconds. Background Mode runs deferrable work at half price, alongside multi-day prompt caching and higher rate limits. Nexus Desktop brings open-model routing into the Codex app, Claude Desktop and OpenCode, with Pro plans from $8 per month. Fireworks also announced No Eval, serverless LoRA inference, the Fireworks Sovereign private preview and a 60+ partner Frontier Ecosystem.

Fireworks Forge Launches: Ultra-fast Inference Preview Hits 1,500 Tokens/s, Half-Price Background Mode, Nexus Desktop for Codex and Claude Desktop, Sovereign Private Preview

Key Takeaways

  • Ultra-fast public preview: on NVIDIA Blackwell, up to 1,500 tokens per second on DeepSeek V4.1 Flash; in Fireworks' benchmark a 30-turn agent task fell from 1 minute to 8 seconds (Fireworks blog)
  • Cost options: Background Mode runs deferrable work at half price; multi-day prompt caching cuts the cost of resuming long context; higher serverless rate limits and Elastic Burst are generally available
  • Nexus Desktop launches: personalized routing across open and closed models inside the Codex app, Claude Desktop and OpenCode; Pro from $8 per month, Teams from $10 per seat per month
  • Training: No Eval (private preview) turns production traces into task evals; serverless LoRA inference (public preview) starts with GLM 5.3 Flash at per-token pricing with no idle charge; free training on Muse Glimmer 30B through November 30
  • Enterprise: Fireworks Sovereign (private preview) runs the inference engine in a customer's own cloud or data center; Fireworks says it already manages over 25,000 GPUs in customer environments; plus a 60+ partner Frontier Ecosystem
Read full story

Entire, led by ex-GitHub CEO Thomas Dohmke, launches a Git forge for agent-human collaboration: Trails replace PRs, pushes up to 89x faster than GitHub per its benchmarks

On Oct 26, Entire co-founder and CEO Thomas Dohmke announced on X and the company blog that Entire is live as "the Git forge for agent-human collaboration." It has three parts: Trails, which replace diff-based review with eval scores computed on every push; Git-compatible distributed hosting that can replicate across regions or mirror from GitHub; and Continuous Memory, which stores agent sessions in the repo. Buildkite and Depot are the first CI integrations, and it is open to any developer today.

Entire, led by ex-GitHub CEO Thomas Dohmke, launches a Git forge for agent-human collaboration: Trails replace PRs, pushes up to 89x faster than GitHub per its benchmarks

Key Takeaways

  • Push speed (vendor-reported, open-source benchmark): Entire 418 pushes/s vs Cursor Origin 65, Pierre 15, GitLab 10, GitHub 4.7, i.e. up to 89x faster than GitHub and 6x faster than Cursor Origin
  • Trails: on every push, several review agents score the change independently in cloud sandboxes (defaults include Security, Slop and Human Review Required), showing the last 5 runs plus the current one; per-repo Gates can require human approval and passing CI before merge
  • Continuous Memory: two open-source, local-first plugins, entire-graph and entire-brain; entire-graph saved up to 71% of tokens in Entire's testing
  • Regions at launch: US, EU, Australia and India; repos can be mirrored from GitHub with GitHub kept as the source of truth
  • Pricing: not stated in the launch post
Read full story

Mistral AI and NVIDIA Forge Industrial Engineering AI Alliance, Previewing 1T Mistral Large 4

At GTC Berlin, Mistral AI and NVIDIA announced a strategic partnership dedicated to advancing AI for industrial engineering, computational physics, and electronic design automation (EDA). The alliance couples Mistral frontier architectures with NVIDIA CUDA-X libraries, Warp physics simulation frameworks, and Omniverse digital twins. Mistral simultaneously revealed architectural specifics for its forthcoming flagship, Mistral Large 4: spanning roughly 1 trillion total parameters with 49 billion active parameters (MoE), trained on 3,800 Grace Blackwell GPUs, with open weights slated for official release at the end of October 2026.

Mistral AI and NVIDIA Forge Industrial Engineering AI Alliance, Previewing 1T Mistral Large 4

Key Takeaways

  • Mistral AI and NVIDIA launched a strategic alliance applying frontier foundation models to CAE, physics AI, and EDA semiconductor design
  • Integrates NVIDIA Warp, CUDA-X simulation libraries, and Omniverse to establish open physics datasets and industrial agent benchmarks
  • Disclosed architectural parameters for Mistral Large 4: ~1T total parameters with 49B active sparse MoE, trained on 3,800 Grace Blackwell GPUs
  • Weights for Mistral Large 4 are scheduled for open-source release at the end of October 2026, joining the Nemotron Coalition
Read full story

MemPilot Unveiled: On-Demand Multimodal Memory Curation for LLM Agents Solving Multi-Session Context Saturation

Researchers introduced MemPilot (arXiv:2610.06830), an on-demand multimodal memory curation framework for LLM agents. Resolving the chronic context explosion and cross-session forgetting that plague autonomous agents handling mixed text, screenshots, and action traces, MemPilot introduces an adaptive policy controlling memory retention, semantic clustering, and targeted retrieval. Across extensive long-horizon multi-modal agent benchmarks, MemPilot cuts active memory footprint by over 60% while substantially improving cross-session task completion.

MemPilot Unveiled: On-Demand Multimodal Memory Curation for LLM Agents Solving Multi-Session Context Saturation

Key Takeaways

  • Researchers introduced MemPilot (arXiv:2610.06830), an on-demand multimodal memory curation framework solving context saturation in LLM agents
  • Features a tri-tier architecture spanning active buffers, an image Memory Gallery, and a long-term semantic knowledge graph
  • Slashes active multimodal token consumption by 60% to 75%, extending agent continuous operational lifespan by over 3x
  • Boosts cross-session task completion by +18.5% over text-only RAG, providing a scalable blueprint for persistent computer-use agents
Read full story
Linked Models & Agents:
ADSponsored

Tracing the Thoughts of a Coding Agent Playing ARC-AGI-3: White-Box Lessons for Continual Learning

Continual learning without weight fine-tuning represents a frontier in LLM agent research. When an agent acts purely by writing and executing Python scripts inside an execution sandbox, every thought, hypothesis, and plan leaves a verifiable trace on disk. In a newly released study (arXiv:2610.11450), researchers subject coding agents to ARC-AGI-3—a suite of instruction-free abstract visual reasoning environments where each sequential level introduces novel causal dynamics. Developing a fine-grained measurement protocol, the authors trace thoughts across file artifacts across seven full evaluation runs spanning three foundation backbones from two major model families. The empirical findings reveal that scripts written for one level are almost never invoked in subsequent levels (only 33 of 630 cross-task references survive), as agents deliberately abandon 74% of scripts at task boundaries to purge level-specific overfitted state while rewriting core rules. Notes are maintained in an append-only fashion, with conflicting claims arbitrated against raw execution logs to achieve selective rather than catastrophic forgetting. Crucially, the study identifies carrying hard-coded variables across task boundaries as the single most devastating failure mode of autonomous agents.

Key Takeaways

  • Presents the first white-box thought-tracing audit of coding agents continually learning across ARC-AGI-3 environments
  • Finds agents deliberately abandon 74% of scripts at task shifts to purge state, settling append-only notes against immutable logs
  • Identifies carrying hard-coded constants across task boundaries as the single most catastrophic agent failure mode
Read full story
Linked Models & Agents:
⚡ ARC-AGI-3⚡ Coding-Agent⚡ Continual-Learning🤖 ARC-Agent🤖 Thought-Tracer🌐 Hugging Face🌐 Open Source Research

RoboRSI: Shanghai AI Lab Unveils Stable and Reusable Robot Self-Evolution, Sweeping 4 SOTA Benchmarks via Multi-Agent TSR

Generalist robots must not only perform diverse tasks, but also autonomously refine their capabilities through trial-and-error experience, consolidating learned strategies into reusable modular assets for future scenarios. However, current robot agents acting through code repair scripts naively without architectural hierarchy: execution feedback cannot be isolated to responsible sub-skills, revisions lack formal contract verification, and modifications frequently trigger catastrophic forgetting. Researchers from Shanghai AI Lab and Tsinghua University introduce RoboRSI (arXiv:2610.12424, code: github.com/nssmd/RoboRSI), a lifelong robot self-evolution framework anchored in Top-Down Skill Refinement (TSR). TSR structures tasks hierarchically into compound, atomic, and base skills bounded by explicit I/O contracts, attributing execution anomalies strictly to responsible branches. A four-agent collective (Manager, Planner, Engineer, and Reviewer) coordinates long-horizon planning, execution, runtime diagnosis, and validated release of validated skills. Deployed on a real-world mobile manipulator, RoboRSI sustained 104 continuous rounds of autonomous multi-object cleanup. In simulation, it sweeps SOTA across LIBERO, LIBERO-PRO, LIBERO-Plus, and RoboTwin, surpassing leading baselines by 2.7 to 11.0 percentage points, with code fully open-sourced.

Key Takeaways

  • Shanghai AI Lab releases RoboRSI, introducing Top-Down Skill Refinement (TSR) and a 4-agent collective for robot code self-evolution
  • Sustains 104 autonomous real-world cleanup rounds and beats strongest baselines across 4 embodied benchmarks by 2.7 to 11.0 points
  • Contract isolation elevates bug attribution accuracy to 95.8%, enabling lifelong accumulation of reusable robot software skills
Read full story

Memento 3: UCL and Huawei Noah's Ark Enable Recursive Self-Improvement for Frozen LLMs via Reflective Rulebooks, Clearing ARC-AGI-3

Endowing artificial agents with general intelligence requires inferring environment dynamics and refining world models continuously in the wild. Fine-tuning models directly is prohibitively expensive and precipitates catastrophic forgetting. Researchers from University College London (UCL) and Huawei Noah's Ark Lab UK present Memento 3 (arXiv:2610.11794), a framework enabling frozen LLM agents to achieve model-based Recursive Self-Improvement (RSI) purely via external memory. The agent maintains a natural-language rulebook representing its evolving hypotheses of environment physics, which is compiled into executable code for fast simulation and action planning. Governed by a continuous observation-reflection-revision-compilation-verification loop, the system leverages prediction errors to refine rules. Edits are merged only after passing LLM semantic alignment audits and deterministic cell-exact replay verification. On the rigorous ARC-AGI-3 abstraction benchmark, Memento 3 solves 100% of levels across all 25 public environments, scoring a perfect 100.0 Relative Human Action Efficiency (RHAE) while utilizing only 44% of human action counts. In Atari Pong, a synthesized feedback controller shuts out opponents 21:0 across three evaluation seeds with zero test-time LLM inference.

Key Takeaways

  • UCL and Huawei Noah's Ark introduce Memento 3, unlocking model-based Recursive Self-Improvement for frozen LLMs via executable rulebooks
  • Compiles natural-language physics hypotheses into code world models validated through cell-exact replay verification
  • Clears all 25 games on ARC-AGI-3 using only 44% of human actions, and delivers 21:0 Pong shutouts with zero runtime LLM calls
Read full story

DeskForge: Scalable Dense Supervision from Controllable Desktop Environments Propels Computer-Use Agent Grounding by 11.5%

Computer-use agents face fundamental grounding bottlenecks in real-world desktop environments due to layered windows, shifting layouts, and visually indistinguishable controls. Existing training datasets suffer from sparse labels and static capture conditions. Researchers from ETH Zurich and IBM Research present DeskForge (arXiv:2610.02320), a controllable synthetic desktop environment that orchestrates real-world software across varied window states, themes, and screen resolutions. DeskForge synthesizes dense annotations by fusing desktop screenshots, accessibility trees, and geometric window hierarchies, yielding DeskForge-1M—a corpus of 1.2M observations and 159.7M annotated UI element instances. Fine-tuning vision-language models on 200K DeskForge-1M examples improves zero-shot GUI grounding across five external benchmarks; Qwen3.5-4B gains 11.51 percentage points on ScreenSpot-Pro and 10.11 points on OSWorld-G. In end-to-end task execution, task completions surge from 31 to 50 on WebArena-Infinity and from 3 to 15 on OpenApps. The dataset, models, and code are open-sourced at saidgurbuz.github.io/deskforge.

Key Takeaways

  • ETH Zurich and IBM introduce DeskForge, a controllable environment synthesizing DeskForge-1M with 1.2M observations and 159.7M UI elements
  • Fine-tuning Qwen3.5-4B boosts GUI grounding by 11.51 points on ScreenSpot-Pro and 10.11 points on OSWorld-G across five external benchmarks
  • Multiplies long-horizon task completion: solves 50/119 tasks on WebArena-Infinity (up from 31) and 5x on OpenApps (from 3 to 15), fully open-sourced
Read full story

Raven: The Harness of Harnesses Enables Composable Cross-Domain Agentic Intelligence and Autonomous Harness Evolution

As AI agents transition from narrow tasks to long-horizon, cross-domain workflows, manual harness engineering has hit an insurmountable complexity ceiling: brittle bespoke scaffolding resists scaling, while domain coupling limits generality. EverMind AI introduces Raven, 'The Harness of Harnesses,' an open-source multi-agent ecosystem that autonomously synthesizes, evolves, and orchestrates modular harnesses tailored to distinct models and problem spaces. Raven encapsulates executable model-harness pairs as composable units of intelligence. Led by a Host Agent managing decomposition, agent matching, and result synthesis, and backed by EverOS and Skill Forge for persistent experience accumulation, Raven proves mathematically and empirically that dynamic harness composition reliably expands task coverage beyond monolithic baselines under matched resource budgets.

Raven: The Harness of Harnesses Enables Composable Cross-Domain Agentic Intelligence and Autonomous Harness Evolution

Key Takeaways

  • Pioneers Raven as 'The Harness of Harnesses', treating executable model-harness pairs as composable units of intelligence
  • Features Host Agent orchestration, EverOS experience archival, and Skill Forge to automate cross-domain harness evolution
  • Demonstrates provable task coverage expansion, outperforming state-of-the-art monolithic agent architectures by 28.6%
Read full story
Linked Models & Agents:

On-Policy vs Off-Policy Distillation Dynamics: Cambridge Empirical Study Reveals Forward KL Invariance and Reverse KL Sensitivity

The thesis that on-policy distillation inherently outperforms offline supervised fine-tuning by reducing catastrophic forgetting and enhancing generalization has become an accepted pillar of post-training. However, researchers from the University of Cambridge led by Mihaela van der Schaar present a definitive study (arXiv:2609.35259, 160+ upvotes on Hugging Face) disentangling rollout policies, token-level KL divergence directions, and optimization dynamics across Llama-3 and Qwen-2.5 models. The empirical findings reveal that rollout policy does not play the primary role: Forward KL is remarkably invariant and resilient across student and teacher rollouts, while Reverse KL is hyper-sensitive and strictly necessitates student-sampled trajectories. Furthermore, catastrophic forgetting and parameter update sparsity are governed predominantly by learning rate schedules, reframing the design space for LLM distillation.

On-Policy vs Off-Policy Distillation Dynamics: Cambridge Empirical Study Reveals Forward KL Invariance and Reverse KL Sensitivity

Key Takeaways

  • Isolates the independent contributions of rollout policy, KL divergence direction, and learning rate in distillation
  • Proves Forward-KL is remarkably invariant to rollout policy, whereas Reverse-KL strictly necessitates student rollouts
  • Reveals catastrophic forgetting and update sparsity are governed by learning rate rather than on-policy data alone
Read full story
ADSponsored

GraphForge Synthesizes Graph-Anchored Workspaces to Train Real-World Working Agents, Pushing OpenHands GDPVal to 1445.7

Real-world working agents capable of reading diverse files, coordinating terminal tools, and producing verifiable deliverables require tasks grounded in realistic multi-file workspaces. Existing data pipelines either synthesize artificial files that lack ecological validity, or sample real files without verifiable rubrics. Researchers from Fudan University and USTC introduce GraphForge, an evidence-graph framework that anchors both task generation and deterministic evaluation rubrics in real workspace files. Fine-tuning Qwen3.6-27B on only 2,169 GraphForge trajectories catapults GDPVal to 1445.7 (+65.7) within OpenHands, while boosting Workspace-Bench-Lite and SpreadsheetBench II by up to 13.7 points under Claude Code.

GraphForge Synthesizes Graph-Anchored Workspaces to Train Real-World Working Agents, Pushing OpenHands GDPVal to 1445.7

Key Takeaways

  • Pioneers GraphForge to synthesize real-world workspaces grounded in topological evidence graphs with deterministic rubrics
  • Drives OpenHands GDPVal to 1445.7 (+65.7 points) by fine-tuning Qwen3.6-27B on only 2,169 curated trajectories
  • Elevates Workspace-Bench-Lite to 63.7 and SpreadsheetBench II to 24.0 under Claude Code runtime environments
Read full story
Linked Models & Agents:

Omni-Embed-Mini Binds 6 Modalities Without Forgetting: MBZUAI Opens 0.9B Dense Distillation Model Outperforming Gemini

Expanding text embedding models to multimodal domains typically triggers catastrophic forgetting in text retrieval, with existing omni-modal embedders ballooning past multi-billion parameters to compensate. MBZUAI researchers introduce Omni-Embed-Mini, a compact 0.9B architecture mapping text, speech, audio, image, video, and rich documents into a single shared cosine space. Crucially, text-side weights remain bit-identical to the base model, guaranteeing zero regression on text retrieval (49.57 nDCG@10 on MTEB-v2 BEIR-8). Powered by dense cascaded caption distillation, Matryoshka SigLIP loss, and online hybrid hard-negative mining, Omni-Embed-Mini is 2.7x to 9.5x smaller than competing open models, while its 2.3B variant surpasses proprietary gemini-embedding-2 on cross-modality averages.

Omni-Embed-Mini Binds 6 Modalities Without Forgetting: MBZUAI Opens 0.9B Dense Distillation Model Outperforming Gemini

Key Takeaways

  • Unifies text, speech, audio, image, video, and rich documents into a single shared space at only 0.9B parameters
  • Guarantees zero text forgetting via bit-identical frozen text weights (49.57 nDCG@10 on MTEB-v2 BEIR-8)
  • 2.3B model variant outperforms proprietary Google gemini-embedding-2 on cross-modality retrieval averages
Read full story
Linked Models & Agents:

On-Policy vs Off-Policy Learning in LLM Distillation: Cambridge Study Reveals KL Direction & Learning Rate Outweigh Rollouts

On-policy learning is widely assumed to mitigate catastrophic forgetting, induce sparser parameter updates, and enhance generalization in LLM post-training. However, standard SFT vs RL comparisons confound rollout policies with optimization objectives. Researchers from the University of Cambridge led by Mihaela van der Schaar conduct a rigorous controlled study across Llama3 and Qwen2.5 on reasoning, scientific, and medical tasks. Their findings challenge conventional dogma: rollout policy plays a secondary role, while token-level KL direction primarily governs task performance and coverage, and learning rate dictates forgetting and update sparsity. Forward KL remains remarkably robust regardless of rollout policies, whereas reverse KL strictly favors student rollouts.

On-Policy vs Off-Policy Learning in LLM Distillation: Cambridge Study Reveals KL Direction & Learning Rate Outweigh Rollouts

Key Takeaways

  • Deconstructs LLM distillation dynamics, challenging the dogma that on-policy rollouts are inherently superior
  • Proves forward-KL is exceptionally robust to rollout policies, matching online rollouts with offline teacher data
  • Demonstrates that catastrophic forgetting and update sparsity are governed by learning rates rather than on-policy sampling
Read full story

Cloudflare launches agentic CLI `cf`: 3000+ API ops from OpenAPI, JSON-default + cloudflare.config.ts

Hono creator @yusukebe amplified Cloudflare’s launch of cf (npm i -g cf): Forge generates 3000+ CLI ops from OpenAPI (vs Wrangler’s ~280), JSON-default output, cf cli search, TypeScript cloudflare.config.ts, and Vite-default local dev. Open beta [email protected].

Cloudflare launches agentic CLI `cf`: 3000+ API ops from OpenAPI, JSON-default + cloudflare.config.ts

Key Takeaways

  • Blog: Introducing cf (2026-09-28) — agents were 48% of Wrangler use last week; surface expands ~280 → 3000+ ops
  • Install: npm i -g cf (1.0.0-beta.5); key cmds cf deploy / cf migrate / cf init / cf cli search
  • Config: TypeScript cloudflare.config.ts with defineConfig / bindings / triggers; Vite-default local DX
  • Pipeline: Forge (Apache 2.0, cloudflare/forge); CLI at cloudflare/cf
  • Migration: final Wrangler major will point to cf, then 18 months maintenance; no model SWE-Bench numbers for this CLI
Read full story
Linked Models & Agents:

Mira open-sources a self-hosted AI code reviewer with full-repo indexing

@DanKornas highlighted miracodeai/mira, a self-hosted AI code reviewer for teams that keep diffs, indexes, review history, and CVE data in their own SQLite or Postgres. It supports OpenRouter and OpenAI-compatible endpoints including vLLM/Ollama, applies per-repo rules via .mira.yaml, and auto-reviews PRs on GitHub, GitLab, and Forgejo/Codeberg. Apache-2.0.

Key Takeaways

  • Self-hosted by default: code and review data stay on your infrastructure.
  • Full-repo indexing plus custom rules go beyond a single diff.
  • Supports GitHub, GitLab, and Forgejo; models via OpenRouter or local OpenAI-compatible endpoints.
Read full story