AI Coding Live News

Tencent ARC in collaboration with Tsinghua University released and open-sourced Looking Ahead (arXiv:2610.29989, GitHub: TencentARC/Looking-Ahead), establishing a breakthrough paradigm for autoregressive video synthesis. Overcoming the chronic pathology of traditional autoregressive video models—where unidirectional sequential extrapolation causes exponential error accumulation and severe visual collapse over extended rollouts—Looking Ahead introduces Lookahead Attention. By coupling casual autoregressive decoding with a forward-looking planning stream that anchors future spatiotemporal keypoints, the framework eliminates cumulative drift and visual jitter in long-form generation.

Zoom

Current memory benchmarks for video world models conflate whether an action was carried out with whether the model remembered its outcome, incorrectly attributing action execution failures to cognitive memory loss. Researchers from HKU and Tsinghua introduced MIST (arXiv:2610.23542, 12 upvotes on Hugging Face). By decoupling physical execution from temporal memory, MIST reveals that up to 70% of apparent memory failures in leading models are actually execution failures. Correcting for execution raises true scene memory accuracy by +11.8 to +29.6 percentage points.

Zoom

Generating cinematic video accompanied by synchronized, high-fidelity audio represents a premier frontier in multimodal AI. Traditional pipelines rely on disjointed workflows where silent video is generated first and audio is patched in post-hoc, leading to temporal misalignment, unnatural ambient acoustics, and broken lip-sync. The Kandinsky research team releases Kandinsky 6.0 Video (arXiv:2610.05608, code: github.com/kandinskylab/kandinsky-6, Hugging Face Diffusers integration). Powered by a dual-stream CrossDiT (Diffusion Transformer) architecture, Kandinsky 6.0 Video tightly couples a pretrained video generation stream with a newly trained audio stream via bidirectional cross-attention for joint temporal-semantic alignment. Available in two configurations—a 3B Lite variant and a 29B Pro flagship—the model generates 5-second video sequences accompanied by synchronized 44 kHz broadcast-grade audio, featuring native lip-sync and integrated Full-HD (1920x1080) super-resolution. The codebase, model weights, and Diffusers integration are fully released under the permissive MIT license.

Zoom

On Oct 7 AWS released Strands Box v0.1.0, an open-source (Rust, Apache 2.0) sandbox for AI agents. It pairs OS-level isolation with the Dogwood policy language: shell, Python, outbound HTTP and MCP calls all pass through one default-deny policy engine with a shared event history, so rules can depend on earlier actions and elapsed time. A gateway injects credentials so the agent never sees the secrets. Preview supports macOS on Apple silicon only; Linux is in development.

Zoom

In long-term companion AI and memory-augmented agent research, standard evaluations rely on synthetic personas and generated queries that artificially predetermine relevance and leak retrieval cues. Researchers introduce RealCompanion (arXiv:2610.01780), releasing a landmark dataset derived from ten genuine human relationships with an AI companion spanning up to 120 days and 27,218 real messages, meticulously annotated with ground-truth reasoning traces. The empirical analysis yields three foundational findings: First, historical memory is rarely required and temporally distant—95.9% of user interactions are satisfied by immediate context, with only 2.2% genuinely necessitating historical memory retrieval; pooled evaluation scores create an illusion of competence where 96% of evidence gains come from queries needing no recall. Second, contemporary memory detectors fail entirely on unprompted human text; synthetic benchmarks leak intent cues, and merely tagging inputs as 'memories' inflates agent retrieval by 10 to 14 points. Third, distinct memory architectures reconstruct human personas with identical F1 accuracy across a staggering 31-fold disparity in computational cost.

Zoom

World Action Models (WAMs) represent a foundational robotic paradigm by predicting future visual dynamics and Cartesian actions directly from initial observations. However, existing WAMs struggle with long-horizon execution: synthesizing dense video rollouts incurs prohibitive computational overhead and temporal drift, while predicting single terminal frames deprives the policy of progressive visual guidance. Meta FAIR and Shanghai Jiao Tong University introduce ProWAM (arXiv:2610.02508), an efficient architecture that jointly predicts actions and an ordered sequence of sparse visual sub-goals. Sub-goal prediction scales naturally by learning from large-scale action-free video datasets, decoupling complex visual foresight from low-level policy control. ProWAM executes a single video-backbone forward pass to cache sparse sub-goal features, enabling rapid closed-loop replanning through lightweight action denoising without full video re-generation. Evaluated across extensive robotic benchmarks, ProWAM sets SOTA records on LIBERO-Plus (85.8%, +35.9% relative gain) and randomized RoboTwin (75.7%). In real-world zero-shot physical manipulator trials, ProWAM achieves a 70.0% success rate in unseen environments, outpacing the strongest baseline by +15.0 percentage points (+27.3% relative gain).

Zoom

Streaming video LLMs must continuously capture temporal evidence before its downstream relevance is known and proactively respond when sufficient evidence arrives. Balancing real-time perception with reusable factual memory has remained a core challenge: revisiting raw visual features explodes memory, while lossy feature pooling destroys critical spatiotemporal context. Researchers from Nanjing University and Shanghai AI Lab introduce OneStreamer (arXiv:2610.01762, ~200 upvotes on Hugging Face). The framework introduces Proactive Hierarchical Caption Memory (PHCM) to generate time-grounded captions and event summaries on the fly, paired with Proactive State Transition Learning (PSTL) to prevent idle waiting frames from overwhelming optimization gradients. Built on the newly released OneStreamer-1M dataset, their 4B model establishes state-of-the-art results across all eight streaming video benchmarks.

Zoom

Understanding long-form video requires multimodal agents to gather and synthesize temporal evidence across dozens of reasoning steps. However, existing architectures predominantly employ append-only working memory, resulting in 'semantic thrashing': as contexts expand, attention across critical facts collapses and the agent loses access to previously discovered clues. Researchers from the University of Rochester and Microsoft Research introduce VideoLoop, an agent architecture featuring two coupled loops: an outer reasoning loop coupled with an inner memory rewriting loop. After each step, the inner loop queries an unbounded filesystem of past observations and continuously rewrites a bounded working memory buffer. VideoLoop provides plug-and-play gains averaging 4.2 points across four major LVLM backbones, propelling Gemini 3.1 Pro to 88.3% on VideoMME (long) and 88.8% on VideoMMMU.

Zoom