AI Coding Live News

Three new evaluation and interpretability studies resolve critical measurement blind spots: POSTECH and KAIST researchers (arXiv:2610.20993) prove across 41 checkpoints and 12 benchmarks that multiple-choice pooled selection-rate SD equals the exact product of Flip Rate and Positional Skew, revealing that forward-reverse order aggregation lowers flip rates partly by locking onto wrong answers; semCER (arXiv:2610.20461) open-sources 61 million LLM-judged grapheme edits across 16 languages for severity-weighted OCR evaluation; and IISc/UVA researchers (arXiv:2610.20680) show that while SAE reconstruction converges with little data, strict 1-to-1 feature reproducibility on Gemma-2-2B BatchTopK jumps 14.5x from 2% at 5M tokens to 29% at 50M tokens.

Zoom

Two mechanistic interpretability studies uncover how LLMs express and localize internal knowledge: University of Cambridge researchers (arXiv:2610.21025) introduce parameter-trajectory crosscoding on checkpoint weights, discovering that hidden states encode task knowledge before the unembedding readout matrix learns to express it (reorganizing at 0.4-1.1% of Pythia pretraining), and that raising the readout learning rate closes this gap earlier. Meanwhile, University of Copenhagen researchers (arXiv:2610.22127) apply paired-activation crosscoders to three open-weight Mixture-of-Experts (MoE) LLMs, isolating monosemantic personalization latents and proving via causal interventions that boosting specific routed experts recovers personalized model behavior.

Zoom

Two top-trending Hugging Face papers dissect the limits of VLM 3D interactive reasoning and LLM mechanistic interpretability: Xiamen University's RoTA-Bench (arXiv:2610.17665, 200 upvotes) evaluates closed-loop 3D-to-2D projection alignment across 674 tasks, finding that humans achieve 100% success while GPT-5.6-Sol reaches only 17%. Meanwhile, UW-Madison's OpenSAE study (arXiv:2610.21261, 104 upvotes) introduces SAE Additivity Residuals (SAR) across 18 model/behavior settings, showing that modeling pairwise feature interactions boosts multi-feature steering rank fidelity from 0.5874 to 0.7790 and cuts ordering error from 0.1444 to 0.0606.

Zoom

On-policy distillation (OPD) is an essential post-training technique for transferring reasoning capabilities from frontier teacher models to smaller students. However, the precise mechanistic impact of OPD on student internal representations has remained poorly understood. Researchers from the University of Hong Kong (HKU) utilize sparse crosscoders paired with a novel 'swap readout' technique to conduct the first mechanistic interpretability investigation of OPD across training checkpoints. The study reveals a fundamental insight: OPD neither creates novel internal features nor injects teacher-specific features; instead, over 98% of the student's frequent features maintain firing rates within 20%. Rather than teaching new concepts, OPD predominantly reweights features the student already possessed. Furthermore, the authors elucidate the mechanistic necessity of preceding SFT warm-ups on teacher rollouts, showing they pre-align shared features while implanting persistent reasoning templates, establishing a foundational mechanistic theory for LLM distillation.

Zoom

Conventional single-image 3D scene reconstruction typically produces static meshes or radiance fields (NeRF/3DGS), which lack modularity, CAD interpretability, and programmatic editability. Researchers introduce LEGO-Anything, an Image-to-Code framework where a coding agent autonomously writes and executes Blender Python scripts, renders multiview checks, and iteratively refines the 3D scene program. To systematically evaluate programmatic 3D recovery, the authors release LEGO-Bench across 208 images from 104 realistic indoor and outdoor environments. Diagnosing three recurrent failure modes in agentic generation—weak layout initialization, regressive edits, and uncalibrated self-evaluation—they propose LEGO-Plugin, a training-free harness delivering up to 62.7% relative improvements across evaluated foundation models while supporting zero-shot downstream 3D spatial queries.

Zoom

Researchers from the Computational Linguistics Laboratory (CoLingLab) at the University of Pisa published an empirical breakthrough on mechanistic interpretability for LLMs, open-sourcing their findings and codebase on GitHub (arXiv:2609.29362). Using Part-of-Speech (PoS) morpho-syntactic categories as a controlled testbed, the study investigates whether grammatical structure in Sparse Autoencoders (SAEs) resides in isolated monosemantic latents or distributed feature geometries. Findings reveal that while PoS categories are readily recoverable from SAE activations and cannot be reduced to lexical memorization, they do not map 1:1 to single latents. Instead, categories are localized in compact, stable clusters of sparse latents with distinct behavior between open and closed classes.

Zoom

A research consortium investigating LLM interpretability has published 'Capable yet Parsimonious: Extracting and Characterizing Hidden Chain-of-Thought in Frontier Models' (arXiv: 2609.26637). Addressing the opacity of closed-source frontier reasoning architectures (such as GPT-6 Astra and OpenAI o3-series) where raw reasoning traces remain concealed behind server-side summaries, the authors discover that registering a simple custom tool schema via standard developer APIs reliably induces frontier models to externalize their raw intermediate thoughts without jailbreaks. Extracted traces match native reasoning performance across competition math and code synthesis, offering a transparent behavioral lens into Astra's token-efficient, directed reasoning trees.

Zoom

A research group focused on mechanistic interpretability has released 'Your Transformer Can Hold Two Thoughts at Once: Evidence of Linear Superposition in LLMs' (arXiv: 2609.29845). Challenging the premise that non-linear activation layers render transformers hopelessly entangling, the authors formulate the Superposition Linearity Hypothesis: linearly combining input representations from distinct text streams yields an output probability distribution that is an exact linear superposition of the individual next-token predictions. Leveraging this intrinsic property, the team introduces a guided decoding method capable of extracting two distinct, coherent narrative continuations simultaneously from a single forward pass.

Zoom