AI Coding Live News

On 2026-11-05 World Labs released research preview Frameboy: a highly optimized Atlas variant streamed from cloud GPUs to the browser at up to ~15 fps (vendor claim) with live camera control. A public demo and a Viewfinder closed-beta overlay shipped together; CEO Fei-Fei Li amplified “Real time Atlas” on X.

Zoom

On 2026-11-05 Hugging Face released the free Ultimate MoE Training Handbook. Co-founder Thomas Wolf cited ~800k GPU-hours, ~70k words and 55 interactive figures; author Nouamane Tazi separately cited ~500k GPU-hours. The Megatron-LM guide covers routing, expert sizing, communication and debugging via the official Space.

Zoom

Flower Labs, the company behind the Flower federated learning framework, released Endeavor 1.1 on November 3, its third model this year after the UK sovereign 7B model Lizzy in April and Endeavor 1.0 in September. The update adds image input, an optional EU-only GPU inference tier, and Flower-managed, private-cloud or on-premises deployment, and promises readable thinking traces plus ownership of outputs that customers may use to train their own models. Vendor-reported scores are GPQA 94.4, HumanEval 99.9, AIME 2026 99.9 and MMMU-Pro 81.1, but the comparison uses GPT-5.6 Sol and Claude Fable 5 rather than either lab's newest models, and access is request-only for now.

Zoom

Anthropic's Frontier Red Team published a research post on November 2 and open-sourced FlashProve under Apache 2.0. A model provider commits to hidden weights once, then attaches a zero-knowledge proof to each reply, so a user without the weights can check on an ordinary CPU that the reply really came from that model. That targets routing services that quietly swap in cheaper models and tampered token streams. Anthropic reports about 110 tokens/s on one H100 for Llama 4 Maverick (400B MoE, 4-bit), proofs of about 19 MB per 1,024-token request, and roughly 70-95x the GPU time of vLLM inference. It is an unmaintained research prototype limited to 1,024-token contexts and greedy decoding of an integer version of the model. Anthropic engineer Steve Weis shared the release on X.

Zoom

In his 2027 budget address to the National Assembly on November 2, South Korean President Lee Jae Myung proposed a record 820.9 trillion won budget (+12.8%), with 21.3 trillion won (about $16B) for semiconductors, physical AI, AI data centers and AI, nearly double the 10.8 trillion won in 2026. The Ministry of Planning and Budget document allocates 4.7 trillion won to a sovereign AI model aiming for world-leading performance, including the purchase of 10,000 Vera Rubin GPUs. Parliament still has to pass the budget.

Zoom

a16z's Charts of the Week for Oct 30 (by Moses Sternstein) looks at the "Rack Spread": GPU rental prices are rising while token prices fall. The official a16z X account summed it up on Oct 31: since May, average token prices are down 67% and token spend is up more than 120%. By the article's napkin math, Ramp data gives roughly 122%, and Ornn's blended price multiplied by OpenRouter volume gives roughly 160%. A separate post says that since mid-July B300 rentals are up 106%, B200 up 66% and H100 up 17%. a16z also stresses that these indexes come from small, biased samples and do not show true total demand.

Zoom

An Oct 30 NVIDIA blog post says Breakthrough Listen and the SETI Institute have brought agents into daily SETI work at the Allen Telescope Array (ATA, 42 dishes of 6 m each) in Northern California: from a single natural-language request, agents can steer the antennas, calibrate and focus, fix data errors, and run AI models on the live stream. Holoscan's DAQIRI library pulls sensor data straight into GPU memory, the SETI Institute's CyberEther handles signal processing, and the web-based orchestrator Nexus acts as the agent harness, handling up to 2.4 Tbps on premises on RTX PRO 6000 Blackwell GPUs. The pipeline has made the first real-time AI detection of a pulsar in the Crab Nebula, and the team is evaluating open models such as Nemotron. The @NVIDIAAI Halloween post on Oct 31 drew about 274 likes.

Zoom

On Oct 28 DiffuSpace, whose members come from the HKU NLP group behind Dream 7B, released its first model, Clover-35B-A3B-Preview: a mixture-of-experts diffusion language model initialized from Qwen3.6-35B-A3B, with 35B total and about 3B active parameters, a 128K context window and block-parallel denoising. Vendor-reported results include 73.6 on SWE-bench Verified, 51.7 on Terminal-Bench 2.1 and 83.8 on GPQA Diamond, with 680 tokens/s on a single GB300 in agent workloads. Weights are Apache 2.0 on Hugging Face, ModelScope and GitHub, with SGLang and llama.cpp support.

Zoom

LMSYS Org in collaboration with the NVIDIA Dynamo team officially unveiled Elastic Expert Parallelism (Elastic EP) with NIXL backend integration in SGLang (@lmsysorg). Addressing the critical vulnerability of large-scale MoE deployments (such as DeepSeek-V3/V4) where static EP causes entire cluster crashes upon single-node failures and prevents live capacity resizing, Elastic EP decouples rigid expert-to-GPU bindings. Leveraging NVIDIA NIXL device APIs and Mooncake orchestrators, SGLang enables live scaling of active MoE serving deployments (e.g. dynamically expanding from 20 to 24 GPUs) without draining traffic or restarting clusters, while delivering resilient fault tolerance.

Zoom

Microsoft shipped Visual Studio Code 1.143. The Copilot harness, built on the Copilot SDK, is now the default for new sessions and works across the editor and Agents window. A Compare Models preview runs several models on one task with an optional Judge model, an experimental mode runs MAI Code 1.1 Flash on a local NVIDIA GPU, and large chats open much faster.

Zoom

At GTC Berlin, Mistral AI and NVIDIA announced a strategic partnership dedicated to advancing AI for industrial engineering, computational physics, and electronic design automation (EDA). The alliance couples Mistral frontier architectures with NVIDIA CUDA-X libraries, Warp physics simulation frameworks, and Omniverse digital twins. Mistral simultaneously revealed architectural specifics for its forthcoming flagship, Mistral Large 4: spanning roughly 1 trillion total parameters with 49 billion active parameters (MoE), trained on 3,800 Grace Blackwell GPUs, with open weights slated for official release at the end of October 2026.

Zoom

The vLLM project team and Ant Group officially open-sourced Humming (humming-kernels), a specialized high-performance kernel library designed for serving quantized MoE and dense LLMs at massive scale. Humming natively supports WnA16, W8A8, W4A8, and W4A4 across INT1–INT8 and FP4–FP8 formats, spanning NVIDIA architectures from Turing through Blackwell as well as T-Head Zhenwu 810E silicon. In production benchmarks, Humming kernels outpace cuBLAS by 3–4x at small batch sizes and surpass Marlin by 2x on H200 clusters. Serving DeepSeek-V4.1-Flash across 8x H20 GPUs, Humming drives a +43.3% throughput gain under 64 concurrent requests while reducing time-to-first-token (TTFT) by 32%, pre-integrated directly into vLLM v0.29.0+.

Zoom

On Oct 21 the vLLM community and Ant Group open-sourced Humming (Apache 2.0), a quantized-inference library that JIT-compiles GEMM kernels on demand. It supports every NVIDIA architecture from Turing on plus T-Head's Zhenwu 810E, and covers weight and activation combinations from INT1-INT8 and FP4-FP8 for dense and MoE workloads. In vLLM's microbenchmarks it runs 2-5x faster than vLLM Marlin, FlashInfer or DeepGEMM in some cases; on 8 H20 GPUs, switching DeepSeek-V4.1-Flash MoE from Marlin W4A16 to Humming W4A8 raised throughput 14-43%. vLLM 0.29.0 ships it built in.

Zoom