AI Coding Live News

On November 10, the Institute of Foundation Models (IFM) at Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) released PAN 2, an open world model. It splits conceptual and perceptual reasoning: a multimodal LLM first writes the current scene and text actions as a time-stamped, structured world state, and a 29B latent diffusion model trained from scratch then renders up to 20 seconds of 704x1248, 24 fps simulated video, so an agent can rehearse each candidate plan before acting. Weights and code are released under Apache 2.0, with day-0 support in Diffusers and vLLM-Omni. IFM also says about two in three simulated multi-step plans still miss at least one step.

Zoom

Researchers from the University of Maryland, Google, and MBZUAI introduced BeliefWeaver (arXiv:2610.18082), an autonomous failure-recovery framework for long-horizon agents. Addressing cases where failures stem from root errors multiple steps earlier that local reflection cannot fix, BeliefWeaver maintains a persistent relational belief state across checkpoints and attempts, using an Implicit World Model (IWM) to evaluate hypotheses and gate repair execution. When distilled into a 9B model via on-policy distillation, it improves final benchmark scores by 9.8 percentage points while slashing teacher API costs by 54.8%.

Zoom

On 2026-10-15, MBZUAI’s Institute of Foundation Models (IFM) and Inception42 released Jais 3—the first language adaptation of the open K2 Horizon fleet. Six open-weight sizes run from a 0.9B dense phone model to a 375B-A23B sparse MoE (≈23B active), plus Jais Speech for Arabic ASR. Models share one training recipe and agent stack, with up to 512K context (128K on 0.9B), Apache-2.0 weights and stage checkpoints on Hugging Face, and day-0 vLLM support.

Zoom

Humans solve complex spatial transformations by mentally simulating physical visual transitions, maintaining visual imaginations to ground multi-step reasoning. In contrast, existing Vision-Language Models (VLMs) tackle spatial questions almost entirely via text-token chains of thought, triggering acute hallucinations when predicting 3D rotations or spatial clearances. Researchers from Carnegie Mellon University and MBZUAI introduce WM-VLM (arXiv:2609.34826), integrating a lightweight world model branch directly into foundation VLMs to synthesize intermediate visual states during inference. The framework adopts a two-stage training paradigm: first training the model to foresee and render verifiable intermediate visual states, and then training it to ground downstream logical deductions upon those synthesized states. Evaluated on rigorous 2D and 3D mental rotation tasks, WM-VLM outperforms standard SFT baselines by up to 39.25 percentage points. Ablations prove that performance collapses when generated visual frames are removed or corrupted, establishing that internal world models provide indispensable spatial cognitive scaffolds.

Zoom

Large language models are rapidly deployed across cybersecurity workflows to translate analysts' intent into command-line interface (CLI) executions. However, existing benchmarks emphasize either high-level knowledge QA or unconstrained agent rollouts, failing to measure precise parameter binding across real-world security tooling where minor syntax glitches invalidate execution. Researchers from MBZUAI introduce KaliBench, a fine-grained natural-language-to-CLI benchmark on Kali Linux spanning 8,504 query-command pairs across 1,642 tools, 23 capability dimensions, and 5 security phases. Auditing reveals no open-weight model surpasses 42% exact accuracy without tool hints. Furthermore, reinforcement learning with KaliBench's runtime-free verifiable rewards elevates an 8B model to rival a 685B MoE frontier model.

Zoom

Expanding text embedding models to multimodal domains typically triggers catastrophic forgetting in text retrieval, with existing omni-modal embedders ballooning past multi-billion parameters to compensate. MBZUAI researchers introduce Omni-Embed-Mini, a compact 0.9B architecture mapping text, speech, audio, image, video, and rich documents into a single shared cosine space. Crucially, text-side weights remain bit-identical to the base model, guaranteeing zero regression on text retrieval (49.57 nDCG@10 on MTEB-v2 BEIR-8). Powered by dense cascaded caption distillation, Matryoshka SigLIP loss, and online hybrid hard-negative mining, Omni-Embed-Mini is 2.7x to 9.5x smaller than competing open models, while its 2.3B variant surpasses proprietary gemini-embedding-2 on cross-modality averages.

Zoom