AI Coding Live News

Tencent Hunyuan open-sources Hy-SimulMT, a Chinese-English real-time simultaneous interpreting model with ~3s lag and live voice cloning

On Oct 26 Tencent Hunyuan (Tencent Hy) open-sourced Hy-SimulMT, a real-time simultaneous interpreting model for bidirectional Chinese-English speech-to-speech translation. It translates while the speaker talks, outputs both translated text and speech, and can clone the speaker's voice in real time. Six checkpoints landed on Hugging Face (30B-A3B translation-only and source-plus-translation Interleave variants, each in BF16, FP8 and GGUF), with the model card listing Apache-2.0; GitHub ships the SimulInfer serving stack and SimulTrain training tools. Vendor-reported: about 3s StreamLAAL on RealSI long-form audio, the lowest among compared systems.

Tencent Hunyuan open-sources Hy-SimulMT, a Chinese-English real-time simultaneous interpreting model with ~3s lag and live voice cloning

Key Takeaways

  • Size and variants: 30B-A3B MoE (about 3B active), six checkpoints: translation-only and Interleave (source plus translation), each in BF16, FP8 and GGUF (Hugging Face collection)
  • Latency (vendor-reported): about 3s StreamLAAL on RealSI long-form audio, the lowest among compared systems, with a GEMBA quality score above the compared open models and 4 of 5 commercial APIs
  • Short-form (vendor-reported): FLEURS 90.3, CoVoST2 75.5, ACL6060 81.2, RealSI-Sentence 84.7, the last being the top score in the table; Qwen3.8-LiveTranslate scores 88.4/82.1/80.5/84.4 in the same table
  • Human comparison: 18 real Chinese and English recordings of about 6 minutes each against 6 CATTI Level 1/2 interpreters; Tencent says quality was on par with often lower latency, and notes the result only covers this small test
  • Deployment: one SimulInfer deploy.sh command starts vLLM (>=0.31) plus a web/WebSocket service; speech output and voice cloning need a separate TTS service; llama.cpp support is not yet merged upstream (SimulInfer docs)
Read full story
Linked Models & Agents:
⚡ Hy-SimulMT-30B-A3B⚡ Hy-SimulMT-30B-A3B-Interleave⚡ Qwen3.8-LiveTranslate🌐 Tencent

Tencent ARC & Tsinghua Open-Source Looking Ahead: Lookahead Attention Eradicates Autoregressive Video Drift

Tencent ARC in collaboration with Tsinghua University released and open-sourced Looking Ahead (arXiv:2610.29989, GitHub: TencentARC/Looking-Ahead), establishing a breakthrough paradigm for autoregressive video synthesis. Overcoming the chronic pathology of traditional autoregressive video models—where unidirectional sequential extrapolation causes exponential error accumulation and severe visual collapse over extended rollouts—Looking Ahead introduces Lookahead Attention. By coupling casual autoregressive decoding with a forward-looking planning stream that anchors future spatiotemporal keypoints, the framework eliminates cumulative drift and visual jitter in long-form generation.

Tencent ARC & Tsinghua Open-Source Looking Ahead: Lookahead Attention Eradicates Autoregressive Video Drift

Key Takeaways

  • Tencent ARC and Tsinghua University introduce Looking Ahead (arXiv:2610.29989), open-sourcing a long-horizon video framework
  • Eliminates exponential error propagation and visual degeneration inherent to unidirectional token-by-token video rollouts
  • Pioneers Lookahead Attention, leveraging global temporal keypoint anchors to constrain local micro-texture rollouts
  • Establishes a new state-of-the-art across physical consistency and dynamic motion metrics for open-weight autoregressive models
Read full story
Linked Models & Agents:

Tongji University & Tencent Introduce GeoState: View-Decoupled 3D World Modeling Prevents Camera Scale Drift Across Waymo and KITTI Rollouts

Modern 3D world models typically use view-dependent features from geometry foundation models (GFMs) as predictive states, entangling camera-induced variations with physical scene dynamics. Tongji University and Tencent introduced GeoState (arXiv:2610.22343). By aggregating multi-view GFM features into a view-decoupled 3D scene state, GeoState models physical scene evolution independently of camera viewpoints, maintaining a single context-derived scale throughout rollouts without per-frame scale realignment.

Tongji University & Tencent Introduce GeoState: View-Decoupled 3D World Modeling Prevents Camera Scale Drift Across Waymo and KITTI Rollouts

Key Takeaways

  • Tongji University and Tencent introduced GeoState (arXiv:2610.22343) for view-decoupled 3D world modeling
  • Separates physical scene evolution from camera-dependent observations via a dedicated scene tokenizer and ray-based geometry decoder
  • Maintains a single context-derived scale throughout multi-second rollouts on Waymo without per-frame scale alignment, outperforming VGGT-World and FR3D
  • Demonstrates robust zero-shot cross-sensor generalization across KITTI and nuScenes datasets
Read full story
Linked Models & Agents:

Zhejiang University & Tencent Open-Source KnowGPO for Deep Search Agents: Knowledge-Grouped RL Outperforms 32B Models, Scoring 40.2 on GAIA

Deep search agents struggle with credit assignment across long, noisy retrieved contexts. Zhejiang University and Tencent open-sourced KnowGPO (arXiv:2610.22331, GitHub: ZJU-REAL/KnowGPO), an RL framework that groups search trajectories by atomic knowledge conditions rather than surface observations. Qwen3-8B fine-tuned with KnowGPO achieves 38.8% on BrowseComp-ZH and 40.2% on GAIA, outperforming GRPO/GiGPO baselines and rivaling 32B open-source search systems.

Zhejiang University & Tencent Open-Source KnowGPO for Deep Search Agents: Knowledge-Grouped RL Outperforms 32B Models, Scoring 40.2 on GAIA

Key Takeaways

  • Zhejiang University and Tencent open-sourced KnowGPO (arXiv:2610.22331) for credit assignment in deep search agents
  • Replaces surface observation matching with atomic knowledge condition states and within-group incremental knowledge rewards
  • Qwen3-8B + KnowGPO scores 38.8% on BrowseComp-ZH and 40.2% on GAIA, outperforming standard GRPO by +5.9 and +5.2 points
  • Allows an 8B model to rival and outperform 32B open-source search systems including WebSailor-32B and ASearcher-Web-32B
Read full story
Linked Models & Agents:
ADSponsored

Tencent Hunyuan open-sources Hy Memory 2.0: ~3B-active memory writer averages 55.49 across four harnesses (vendor-reported, edging Opus 5), plus MemHub local memory for Claude Code, Cursor and Codex

On Oct 16 Tencent Hunyuan open-sourced Hy Memory 2.0 in three layers: the Apache-2.0 memory-writer model Hy-Memory-30B-A3B (~3B active, HF weights plus arXiv report), a Python SDK covering Chat, Working and Coding scenes (PyPI hy-memory 2.0.x), and local-first MemHub (CLI + macOS, preview). Per Tencent, swapping it in as the writer across Mem0, MemOS, Hy-Memory and held-out EverMemOS yields a 55.49 average vs 54.62 for Claude Opus 5, measured on fixed 20% subsamples; it still trails Opus 5 on several individual metrics.

Tencent Hunyuan open-sources Hy Memory 2.0: ~3B-active memory writer averages 55.49 across four harnesses (vendor-reported, edging Opus 5), plus MemHub local memory for Claude Code, Cursor and Codex

Key Takeaways

  • Vendor-reported: 55.49 four-harness average vs 54.62 for Claude Opus 5 and 53.64 for DeepSeek V4.1 Flash
  • Held-out EverMemOS: 56.89 vs Opus 5 at 54.04; still trails on Mem0 LoCoMo (59.54 vs 69.47)
  • ~3B active, Apache-2.0, tested on vLLM v0.31.0 with an OpenAI-compatible API
  • SDK installs via pip install hy-memory with automatic Chat/Working/Coding routing
  • MemHub runs on Linux and macOS (preview); Windows unsupported
Read full story

Terminal-RSI: Recursive Self-Improving Terminal Agents via Trajectory Self-Rewrite and Critic-Inheriting Policy Refinement Hit 86.52% on Terminal-Bench 2.1

Terminal agents frequently struggle to convert partial command-line progress into complete end-to-end task resolution. Researchers from Tencent AI Lab and NUS introduce Terminal-RSI, alternating Recursive Self-Rewrite (RSR) of verified trajectories with critic-inheriting Recursive Policy-Refine (RPR) alongside Turn-Boundary Skip-Observation GAE (TB-GAE). Evolving Qwen3.8-27B across five stages yields Terminal-RSI-27B, achieving 86.52% on Terminal-Bench 2.1 and 79.00% on Terminal-Bench Hard.

Terminal-RSI: Recursive Self-Improving Terminal Agents via Trajectory Self-Rewrite and Critic-Inheriting Policy Refinement Hit 86.52% on Terminal-Bench 2.1

Key Takeaways

  • Five-stage recursive self-improvement: alternates verified trajectory Recursive Self-Rewrite (RSR) with critic-inheriting Recursive Policy-Refine (RPR) on Qwen3.8-27B
  • Turn-Boundary Skip-Observation GAE (TB-GAE): retains token-specific baselines while decaying strictly across interaction turns rather than verbose shell output logs
  • State-of-the-art terminal performance: reaches 86.52% on Terminal-Bench 2.1, 79.00% on Terminal-Bench Hard, and lifts LHTB strict completion from 0/46 to 5/46
Read full story

Tencent Hunyuan Releases LifeSearch: The First Real-World Life & Productivity Benchmark for Deep Research Agents, 4,500 Hours of Human Annotation Shows Frontier SOTA at Just 63.4%

While deep research (DR) agents excel on synthetic and academic queries, their reliability in realistic personal life and professional workflows remains uncharted. Tencent Hunyuan introduces LifeSearch, a rigorous benchmark featuring 203 real-user tasks across 7 domains backed by 4,500+ hours of expert annotation and 4,000+ fine-grained rubrics. Evaluating 12 leading DR agents reveals that the strongest frontier agent scores only 63.4%, unmasking persistent bottlenecks in multi-step information synthesis and constraint verification.

Tencent Hunyuan Releases LifeSearch: The First Real-World Life & Productivity Benchmark for Deep Research Agents, 4,500 Hours of Human Annotation Shows Frontier SOTA at Just 63.4%

Key Takeaways

  • Pioneering real-world life & productivity testbed: spans 203 bilingual tasks across 7 realistic domains including travel itinerary synthesis, procurement, and healthcare analysis
  • 4,500 hours and 4,000+ expert rubrics: evaluates both synthesized report depth and concrete attributes (exact values, units, dates, and live URLs) with Spearman rank correlation of 0.89
  • Revealing severe frontier agent limits: the highest-performing deep research agent scores a modest 63.4%, exposing widespread failures in temporal conflict resolution and deep search navigation
Read full story

RSIPO: Recursive Self-Improving Policy Optimization for Agentic RL Achieves 98.6% Success on ALFWorld via Skill-Policy Co-Evolution

To improve credit assignment in long-horizon agentic tasks, combining reinforcement learning with verifiable rewards (RLVR) and on-policy self-distillation (OPSD) has emerged as a leading paradigm. However, existing pipelines neglect the dynamic evolution of agentic skills and the reliability of privileged teacher signals. Researchers from CUHK and Tencent introduced RSIPO, enabling skills and policies to co-evolve recursively. RSIPO extracts skills directly from trajectory rollouts, optimizes skill generation via replay, and employs Empirical Bayes shrinkage to calibrate student trust in teacher logits. Operating on Qwen2.5-7B, RSIPO achieves 98.6% success on ALFWorld, outperforming standard GRPO by 17.4 percentage points.

RSIPO: Recursive Self-Improving Policy Optimization for Agentic RL Achieves 98.6% Success on ALFWorld via Skill-Policy Co-Evolution

Key Takeaways

  • Co-evolution of skills and policies: the agent continuously extracts skills from executed trajectories, breaking the rigidity of static skill registries
  • Empirical Bayes shrinkage calibration: dynamically modulates student trust in teacher supervision, shielding the policy from noisy privileged guidance
  • State-of-the-art 98.6% on ALFWorld: delivers a 17.4 percentage-point improvement over standard GRPO on Qwen2.5-7B, excelling across embodied and search tasks
Read full story

SWR: Self-Supervised Scaling of Scientific Terminal Environments for Coding Agents Surges Terminal-Bench 2 to 53.56%

Terminal coding agents are expanding from standard software engineering into scientific domains like bioinformatics, materials science, and physics. However, building training sandboxes requires executable reference behavior and rigorous verifiers capable of distinguishing true semantic correctness from superficial syntactic mimicry—a process that currently requires tedious manual engineering per task. Researchers from Tsinghua University and Tencent introduce Software-in-the-Loop Reconstruction (SWR, arXiv:2610.02710), a self-supervised environment scaling framework. SWR extracts ground-truth outputs and verifiers from existing executable scientific software workflows by perturbing input configurations into public observations and hidden evaluations. Agents synthesize complete, editable programs from input-output schemas without viewing source code, evaluated by hierarchical verifiers testing semantic fidelity, structural integrity, and anti-shortcut compliance. Implemented across 500 workflows and 46 software suites spanning six scientific domains, SWR generates 1,422 verified trajectories. Supervised fine-tuning of Qwen3.8-27B elevates Terminal-Bench 2 average success from 47.94% to 53.56%, establishing a scalable paradigm for scientific terminal agent training.

SWR: Self-Supervised Scaling of Scientific Terminal Environments for Coding Agents Surges Terminal-Bench 2 to 53.56%

Key Takeaways

  • Introduces SWR to bootstrap self-supervised terminal agent training sandboxes from existing scientific software workflows
  • Decouples public observations from hidden evaluations, using hierarchical verifiers to block shortcuts during program reconstruction
  • Drives Qwen3.8-27B performance on Terminal-Bench 2 from 47.94% to 53.56%, eclipsing all token-matched baseline controls
Read full story

Recursive Self-Rewrite (RSR) Scales Complex Terminal Trajectories: Distilling Specialized Harnesses into General SFT Capabilities

Collecting successful trajectories for complex terminal tasks is essential for post-training coding agents. However, solving difficult tasks often relies on specialized harnesses that incorporate domain assumptions unavailable during real-world deployment; naive SFT on these traces causes verifier leakage and harness over-fitting. Researchers from the University of Maryland and Tencent AI Lab introduce Recursive Self-Rewrite (RSR, arXiv:2610.02826). Using a single foundation model (Qwen-3.8-27B), RSR pairs a planner (extracting operational runbooks), a critic (eliminating leakage), and an executor (replaying runbooks in fresh isolated sandboxes). RSR expands 2,001 specialized source rollouts into 11,094 clean general-harness trajectories, boosting Terminal-Bench 2 Pass@3 from 57.0% to 74.2% and surging Terminal-Bench Hard success from 39.0% to 63.0%.

Recursive Self-Rewrite (RSR) Scales Complex Terminal Trajectories: Distilling Specialized Harnesses into General SFT Capabilities

Key Takeaways

  • Pioneers Recursive Self-Rewrite (RSR) to distill specialized harness experiences into clean general-harness SFT trajectories
  • Expands 2,001 noisy exploration rollouts into 11,094 fully reproducible trajectories in pristine sandboxes
  • Drives Terminal-Bench 2 Pass@3 from 57.0% to 74.2% and lifts Terminal-Bench Hard success from 39.0% to 63.0%
Read full story
ADSponsored

Better Supervision Is Nearby: Tencent AI Lab Unveils Neighborhood On-Policy Self-Distillation (N-OPSD) for Math Reasoning

On-policy self-distillation (OPSD) trains mathematical reasoning models by deploying a privileged teacher that observes ground-truth solutions to supervise student-sampled prefixes. Standard OPSD fixes the teacher parameters across all states, leaving valuable supervision untapped. Researchers from Tencent WeChat and Tencent AI Lab propose Neighborhood OPSD (N-OPSD). They discover that local parameter perturbations in the privileged teacher reveal complementary, reference-aligned corrections across distinct token positions. Offline greedy pruning compiles a compact pool of frozen neighbor experts, while an online MaxPeak and quantile router dynamically selects the optimal expert distribution. Across AIME 2024, AIME 2025, and HMMT 2025, N-OPSD improves Average@12 by up to 2.75 points on Qwen3-1.7B, 4B, and 8B models without any inference overhead.

Better Supervision Is Nearby: Tencent AI Lab Unveils Neighborhood On-Policy Self-Distillation (N-OPSD) for Math Reasoning

Key Takeaways

  • Pioneers Neighborhood OPSD (N-OPSD), revealing local teacher parameter perturbations unlock dense complementary supervision
  • Improves Average@12 across AIME 2024, AIME 2025, and HMMT 2025 by up to 2.75 points on Qwen3 models
  • Features MaxPeak anchor routing and zero-overhead student inference, requiring zero extra runtime parameters
Read full story

SGLang v0.5.20 Released: 713 Merged PRs, RL Sampling Masks & Overlap Scheduling Boost Throughput by 52%

High-throughput LLM inference engine SGLang released milestone v0.5.20, consolidating 713 merged PRs from 237 contributors. The update introduces native return_sampling_mask for reinforcement learning (RL) rollouts, returning exact token support and log-probabilities per decode step to eliminate post-hoc Top-k/Top-p reconstruction during PPO/GRPO/DPO training. Paired with overlap scheduling, decode throughput increases by 17% at batch size 1 and 52% at batch size 64 on Qwen3-8B. The release also implements a unified radix tree with branching-point caching for sliding window attention (SWA) and brings first-day support for GLM-5.3-Flash, Tencent Hy4-Preview, and Qwen3.8-Flash-Next.

SGLang v0.5.20 Released: 713 Merged PRs, RL Sampling Masks & Overlap Scheduling Boost Throughput by 52%

Key Takeaways

  • Massive release: 713 merged PRs from 237 contributors covering RL rollouts, overlap scheduling, and multi-model support
  • Zero-reconstruction RL rollouts: return_sampling_mask returns token candidates and log-probs to streamline GRPO/PPO training
  • 52% decode throughput gain: overlap scheduling boosts Qwen3-8B decoding by 17% at batch 1 and 52% at batch 64
  • Unified Radix Tree for SWA: enables branch-point caching across sliding-window and hybrid-attention model architectures
  • Day-one frontier model support: out-of-the-box support for GLM-5.3-Flash, Tencent Hy4-Preview, Qwen3.8-Flash-Next, and SenseNova MoT
Read full story
Linked Models & Agents:
⚡ GLM-5.3-Flash⚡ Qwen3.8-Flash-Next⚡ Hy4-Preview⚡ SenseNova-U1.5-8B-MoT🤖 SGLang Server🌐 sgl-project🌐 LMSYS

Tencent Hunyuan & Fudan University Open-Source ExplorationBench: Verifiable Alien Worlds Benchmark for Scientific Exploration

Tencent Hunyuan in collaboration with Fudan University's NLP group has open-sourced ExplorationBench (arXiv: 2609.30199, Project: explorationbench.com), establishing a rigorous framework to quantify an AI agent's genuine scientific exploration and hypothesis-testing capacity. To prevent models from cheating via pre-training memorization, the benchmark introduces 'Alien Worlds'—computational sandbox environments (AlienCode and AlienLogic) governed by strictly executable rules that directly contradict terrestrial intuition. Agents must actively frame hypotheses, design probe experiments via API tools, and revise causal models under feedback.

Tencent Hunyuan & Fudan University Open-Source ExplorationBench: Verifiable Alien Worlds Benchmark for Scientific Exploration

Key Takeaways

  • Pioneers 'Alien Worlds' executable sandboxes whose rules contradict earthly knowledge, preventing pre-training data leakage.
  • Comprises two distinct discovery sandboxes—AlienCode and AlienLogic—spanning 55 discovery targets and 140 scientific tasks.
  • Furnishes agents with intentionally flawed documentation, environmental feedback, and dedicated tool-calling interfaces.
  • Benchmarking 10 frontier models reveals that while leading models discover novel rules, extended exploration frequently stalls or degrades early gains.
  • Project portal, sandbox execution runtimes, and evaluation suites released openly on GitHub.
Read full story

Tencent and ZJU Open-Source IterSynth: Decoupled Deep-Search Agent Architecture Outperforms Existing 8B Baselines

Tencent and Zhejiang University's REAL Lab have open-sourced IterSynth (arXiv: 2609.29444, GitHub: Tencent/IterSynth), a groundbreaking paradigm for deep-search AI agents. Breaking free from the rigid single-agent ReAct framework where planning, evidence retrieval, and synthesis are tightly coupled—which typically causes severe context saturation and attention degradation—IterSynth alternates between a specialized Planner and a Synthesizer governed by an evolving summary state. Powered by Role-Decoupled Policy Optimization (RDPO), IterSynth-8B hits an average score of 50.7 across long-horizon benchmarks like BrowseComp and Xbench-DS, outperforming all prior <=8B search agents by +4.2%.

Tencent and ZJU Open-Source IterSynth: Decoupled Deep-Search Agent Architecture Outperforms Existing 8B Baselines

Key Takeaways

  • Decouples single-policy ReAct agent architectures into specialized Planner and Synthesizer roles.
  • Maintains an evolving summary state that slashes token context noise from multi-hop web scraping by 70%.
  • Introduces Role-Decoupled Policy Optimization (RDPO) combining terminal rewards with fine-grained rubric evaluations.
  • IterSynth-8B achieves a record 50.7 score on BrowseComp and Xbench-DS, lifting zero-shot reasoning on proprietary models.
  • Complete PyTorch training harness, benchmarks, and checkpoints open-sourced on GitHub under Tencent.
Read full story

Tencent Hunyuan launches WebCraftBench: coding agents use live sites with coverage-guided scoring

Tencent Hunyuan (@TencentHunyuan) introduced WebCraftBench for the common failure mode where an agent claims a site is done while the homepage errors, buttons overlap, or an unrequested login flow appears. Agents operate the live app; coverage-guided exploration finds unreached paths; aesthetics, usability, and request match are scored. On 197 human-validated pairs it matches human preference 85.3%. Paper: https://arxiv.org/abs/2609.15387

Key Takeaways

  • Agents are evaluated on live apps, not only static screenshots or code diffs.
  • Coverage-guided exploration finds pages and flows that were never reached.
  • Matches human preference 85.3% on 197 validated pairs; paper arXiv:2609.15387.
Read full story