AI Coding Live News

On Oct 27 OpenBMB (ModelBest) open-sourced the MiniCPM-OCR suite with two models: MiniCPM-OCR 1.0, a 1.3B-parameter document parser that scores 93.68 on Real5-OmniDocBench and 54.7 on OCRBench v2 (vendor-reported), and MiniCPM-OCR Jev, a 2B OCR quality judge that scores any parser's output region by region from 0 to 1 and flags content that needs human review. Code and weights are Apache 2.0, with day-one support for vLLM, SGLang, llama.cpp, Ollama and multiple chip platforms.

Zoom

On Oct 21, Baseten's research team Base Labs released open decision models mammoth-1 (27B) and elephant-1 (9B), full fine-tunes of Qwen3.5 that skip text generation and return per-option probabilities in one forward pass for routing, classification and scoring. Per Baseten, mammoth-1 tops the Jev Decision Index 0.4 at 71.24 and elephant-1 ties for #1 on the Artificial Analysis Decision Index. Weights are on Hugging Face and the Baseten API is free through Oct 27.

Zoom

The vLLM team announced two major milestones: shipping precompiled Python bytecode via uv in v0.32.0 release images cuts cold-start container launch by 14–18% (~18s on NVIDIA H100) with zero runtime recompiles. Additionally, vLLM integrated the Decision 3.0 (D3) structured reasoning family (0.6B to 27B) into the /v1/systemone endpoint, ranking #1 on the Jev Decision Index and delivering 1.8x req/s on a single AMD MI325X under 64 concurrent clients.

Zoom

Tackling high latency and safety failures in spatial VLM and embodied VLA deployment, MJev-Spatial (arXiv:2610.22276, #1 on HF Daily Papers with 350 upvotes) reformulates spatial judgment as single-pass native Q/K attention matching with zero added parameters—achieving 65.64% across 12 benchmarks while running 5.6x faster than its Qwen3.5-4B base—while CUHK JIA-Lab's CarryOn (arXiv:2610.21453) wraps frozen VLA policies in a dual-loop harness that cuts safety violations from 52.6% to 6.1% and raises physical recovery success from 13% to 80%.

Zoom

Standard agent harnesses invoke massive LLMs at every step, even though most steps reduce to discrete multiple-choice decisions such as selecting the next tool. Researchers from UIUC, Yale, and Princeton introduce JevAgentHarness, AgentDecisionBench, and the open AgentDecision-4B model. By calibrating per-choice confidence thresholds and training on post-mistake states, JevAgentHarness makes agents 81.1%–89.0% cheaper and up to 2.5x faster while solving 91.5% of out-of-distribution tasks.

Zoom

On Oct 12 Subquadratic released SubQ Snap (public preview, subq-snap-preview), a decision model that scores a fixed answer set instead of generating text. Built on Subquadratic Sparse Attention, it reads up to 384K tokens of text and images, returns a decision on 100K tokens in about a second, and—per vendor numbers—scores 61.7 on Decision Index 0.2.1 vs Jev's 57.9. Input costs $0.05/M tokens; output is free.

Zoom

On Oct 11 the vLLM Semantic Router (vllm-sr) team released the Decision 3.0 family (d3, d3-flash, d3-mini, d3-nano, d3-lite, d3-edge) on Hugging Face under Apache-2.0. Built on Qwen3.5/3.8, the models take text, images and video and return probabilities for choice, yes/no and score questions in one call without generating text. Vendor-reported: the 27B d3 scores 64.7 on Jev Decision Index 0.3.1, ahead of Perplexity Decider v1.1 (62.8) and Decision 2.0 (55.9), with a 55 ms median text latency on one AMD MI325X.

Zoom

Indie developer Nandakishor M open-sourced Vega (pip package vegaml, Apache 2.0): a frozen Qwen3.5-0.8B (4B also available) only reads, while a 57 MB trained engine models each allowed answer as a valley and rolls a damped ball into one, returning calibrated probabilities, conformal answer sets and an abstain flag. 73,728-token context and image input. The author's own paired tests beat hosted Jev 1.13.0 on tasks like phishing screening, while admitting it trails on reranking and multi-step reasoning.

Zoom

TypeSafe AI announced an $870M Series A at a $7.5B valuation on Oct 9, led by a16z with Sequoia and existing investor DCVC; Martin Casado joins the board. Its 'System One' decision model Jev launched Sept 15 and returns calibrated, typed decisions instead of text. TypeSafe says a third of the Fortune 500 use it; a16z's post says 25% — the figures differ.

Zoom

Perplexity released pplx-decider-v1.1-27b (Apache-2.0, fine-tuned from Qwen3.8-27B) on Hugging Face. It returns typed, probability-calibrated answers instead of text. Overall Decision Index is 61.56 vs 56.4 for v1 and 57.9 for Jev, and it is served via the Perplexity Decisions API.

Zoom

On 2 Oct 2026 OpenRouter shipped Model Router Benchmarks: seven model routers (Auto, Jev, NVIDIA Switchyard, Unbiased Pareto, Sakana Fugu, and variants) compared on GPQA Diamond, Tau3 Banking, MMMU Pro Vision, SWE Atlas QA, Deep SWE, and Terminal Bench 2.1. The Router Index defaults to quality 60% / time 20% / cost 20%. openrouter/pareto-code and Fusion are not on this board.

Zoom

Conventional LLM agents emit reasoning thoughts and actions token-by-token, making extended interactions slow and compute-heavy. While Jev-style probabilistic models deliver rapid predictions over finite action domains, they mandate pre-specified, static fields, precluding autonomous adaptation in open-ended language tasks. Shanghai Jiao Tong University researchers introduce JevSpawn, a compositional policy framework bridging natural language instructions with finite probabilistic exploration. JevSpawn couples parallel action spawning with feedback-driven branch selection, representation revision, and recovery from cached alternatives. By sharing prefix KV caches and action structures, JevSpawn eliminates repeated context generation without model training, systematically outperforming seven leading agent baselines across eight benchmarks.

Zoom

On 2026-10-02 ggml-org announced llama.cpp server support for Decision Models via /v1/systemone (PR #29818, merged 2026-10-02T09:56Z). Send a state plus typed questions; get option probabilities in one forward pass. Day-0 models: Julia-1, Laya, Kev-4B, lev, OpenJev (vision). Cloudflare Clef is planned next.

Zoom