AI Coding Live News

Sarvam Releases Prism, an Open-Weight Decision Model Built on Sarvam 105B That Returns Calibrated Option Probabilities in About 44 ms, Apache 2.0

Indian AI company Sarvam released Sarvam Prism on November 3, a "System One" decision model for enterprise workflows: given a context and questions with fixed answer options, it returns a probability for every option in a single forward pass instead of generating text. Sarvam says that across the 25 decision models it tested, Prism averages 71.8 over three indices with a median response time of 44 ms on one B200, the highest score under 100 ms, and scores 82.5 on its Indian-language benchmark. Weights are on Hugging Face under Apache 2.0, with a hosted API as well. All scores are Sarvam's own measurements.

Sarvam Releases Prism, an Open-Weight Decision Model Built on Sarvam 105B That Returns Calibrated Option Probabilities in About 44 ms, Apache 2.0

Key Takeaways

  • Trained on the Sarvam 105B (105B-10B MoE) base; it only outputs option probabilities, so the answer is always one of the given options.
  • Vendor-reported indices: Jev Decision Index 67.0, Sarvam's recreation of the Artificial Analysis decision index 65.9, internal Indian-language benchmark 82.5, average 71.8; Perplexity Decider v1.2 averages 68.0 at about 117 ms.
  • Calibration: on English answers at 90%+ confidence it expects 3.3% errors and makes 2.2%; in Indian languages 5.4% expected vs 4.4% actual, while rivals underestimate errors by 1.5x to 4.8x.
  • By sorting options into a fixed order before scoring, it changed 0 of 2,000 answers across four shuffled option orders.
  • On 700 recorded agent runs it judges correctly 78.5% of the time overall, vs 70.7% for Claude Haiku 5.5.
  • Self-hosting needs one FP8-capable GPU with about 120 GB free memory (such as B200 or H200) and about 106 GB of disk for weights.
Read full story
Linked Models & Agents:
⚡ Sarvam Prism⚡ Sarvam 105B⚡ Perplexity Decider v1.2⚡ Jev 1.14⚡ Microsoft-Decision-1⚡ Claude Haiku 5.5🌐 Sarvam

Cadence launches Maestro, a domain-specialized AI model portfolio for agentic chip and system design built in part on NVIDIA Nemotron, claiming up to 30% better results and 5x token efficiency

EDA leader Cadence announced the Maestro AI Model Portfolio on October 26: domain post-trained LLMs, trained decision models and self-improving agent skills that power its AuraStack, ChipStack, InnoStack and ViraStack AI Super Agents as they drive Cadence EDA and SDA tools. Cadence solvers score outputs against engineering constraints to close a reinforcement learning loop. Initial results per Cadence show up to 30% higher quality and up to 5x token efficiency versus a general-purpose foundation model. NVIDIA contributes Nemotron and OpenShell, and the stack runs on Cadence cloud, public cloud or on-premises. The first models reach select early access customers in Q4 2026.

Key Takeaways

  • Maestro is a portfolio, not one model: domain post-trained LLMs, decision models and self-improving agent skills, mixed with frontier and open-weight models per task
  • Deterministic solvers and EDA tools score outputs against engineering objectives and constraints, feeding a verified reinforcement learning loop
  • Per Cadence: up to 30% higher quality of results and up to 5x token efficiency versus a general-purpose foundation model; no third-party evaluation yet
  • NVIDIA supplies Nemotron models and the OpenShell sandbox reference architecture; customers can post-train on their own designs and run on-premises
  • First models go only to select early access customers in Q4 2026; Socionext expects up to 5x productivity from deploying InnoStack
Read full story

Baseten open-sources decision models mammoth-1 (27B) and elephant-1 (9B): per-option probabilities instead of text, #1 on the Jev Decision Index

On Oct 21, Baseten's research team Base Labs released open decision models mammoth-1 (27B) and elephant-1 (9B), full fine-tunes of Qwen3.5 that skip text generation and return per-option probabilities in one forward pass for routing, classification and scoring. Per Baseten, mammoth-1 tops the Jev Decision Index 0.4 at 71.24 and elephant-1 ties for #1 on the Artificial Analysis Decision Index. Weights are on Hugging Face and the Baseten API is free through Oct 27.

Baseten open-sources decision models mammoth-1 (27B) and elephant-1 (9B): per-option probabilities instead of text, #1 on the Jev Decision Index

Key Takeaways

  • Benchmarks (vendor): mammoth-1 scores 71.24 on Jev Decision Index 0.4, #1 of 208 decision models; 65.9 on AA Decision Index
  • elephant-1 (9B): 62.6 on Jev, best 9B; 65.2 on AA Decision Index, tied #1 with d1-ultra
  • Training: full fine-tunes of Qwen3.5-27B / 9B on 6.21M decision examples incl. abstention and safety data
  • Mechanism: block-bidirectional attention plus shared-prefix caching, one forward pass for many questions; up to ~10x faster than a reasoning model (vendor claim)
  • Try it: Hugging Face weights (MIT); Baseten API free until Oct 27 11:59 PM PT with zero data retention
Read full story
Linked Models & Agents:
⚡ Mammoth 1⚡ Elephant 1⚡ Qwen3.5-27B⚡ Qwen3.5-9B🌐 Baseten🌐 Base Labs

Perplexity Releases Open-Weight Multimodal Decision Models pplx-decider-v1.2 (27B) and Flash (4B) on OpenRouter and Vercel AI Gateway

Perplexity Developers (@perplexitydevs) announced the launch of pplx-decider-v1.2 (27B) and pplx-decider-flash-v1.2 (4B) across OpenRouter and Vercel AI Gateway. Taking both text and images as input, these open-weight multimodal decision models return typed answers with calibrated probabilities at just $0.02 per million input tokens for the 27B checkpoint and half the cost for the 4B Flash variant.

Perplexity Releases Open-Weight Multimodal Decision Models pplx-decider-v1.2 (27B) and Flash (4B) on OpenRouter and Vercel AI Gateway

Key Takeaways

  • Dual open-weight multimodal decision models: launches 27B pplx-decider-v1.2 and 4B pplx-decider-flash-v1.2 taking text or images and returning typed answers with probabilities
  • Ultra-low $0.02/1M token pricing: 27B checkpoint costs $0.02 per million input tokens, while 4B Flash runs faster at half the price
  • Live on OpenRouter and Vercel AI Gateway: provides drop-in rolling aliases for low-latency agent routing and multimodal classification
Read full story
Linked Models & Agents:
ADSponsored

Liquid AI releases d1-ultra decision model: calibrated probabilities with zero generated tokens, #1 on Artificial Analysis Decision Index (65), $0.042 per M input tokens

Liquid AI released d1-ultra on Oct 15: a multimodal decision model that takes text and images and, in one forward pass, returns probabilities for yes/no, choice and score questions without generating tokens; billed on input only. Artificial Analysis ranks it #1 on Decision Index v1.0 at 65, at least 8 points ahead, with an 85% non-hallucination rate. Available on the Liquid API, Vercel AI Gateway and OpenRouter.

Liquid AI releases d1-ultra decision model: calibrated probabilities with zero generated tokens, #1 on Artificial Analysis Decision Index (65), $0.042 per M input tokens

Key Takeaways

  • Artificial Analysis Decision Index v1.0: 65, ranked #1 and at least 8 points ahead (independent)
  • AA-Omniscience-Decision non-hallucination 85% vs 40% for runner-up Microsoft-Decision-1; more abstention drops accuracy to 32% vs d1's 41%
  • $0.042 per M input tokens, output free; a 1024x1024 image counts as 1,536 tokens
  • 32,768-token context, 44 languages, leads all eight categories of Liquid's 112-eval suite (vendor)
  • Call via Liquid /decisions/v1/systemone with model d1-ultra, or liquid/d1-ultra on Vercel AI Gateway / OpenRouter
Read full story
Linked Models & Agents:

JevAgentHarness & AgentDecision-4B: Sharing Control Between 4B Decision Models and LLMs Makes Agents 2.5x Faster and 89% Cheaper

Standard agent harnesses invoke massive LLMs at every step, even though most steps reduce to discrete multiple-choice decisions such as selecting the next tool. Researchers from UIUC, Yale, and Princeton introduce JevAgentHarness, AgentDecisionBench, and the open AgentDecision-4B model. By calibrating per-choice confidence thresholds and training on post-mistake states, JevAgentHarness makes agents 81.1%–89.0% cheaper and up to 2.5x faster while solving 91.5% of out-of-distribution tasks.

JevAgentHarness & AgentDecision-4B: Sharing Control Between 4B Decision Models and LLMs Makes Agents 2.5x Faster and 89% Cheaper

Key Takeaways

  • Uncovers the static-to-agentic gap: builds AgentDecisionBench and shows uncalibrated tool delegation drops agent task success by 19.0 points
  • Per-choice thresholding & post-mistake training: introduces JevAgentHarness and open AgentDecision-4B trained on states reached after agent errors
  • 2.5x faster and up to 89% cheaper: slashes inference cost by 81.1%–89.0% while achieving 91.5% task resolution on out-of-distribution benchmarks
Read full story

Subquadratic launches SubQ Snap: a 384K-context decision model for agent routing, tool picks and checks at $0.05/M input

On Oct 12 Subquadratic released SubQ Snap (public preview, subq-snap-preview), a decision model that scores a fixed answer set instead of generating text. Built on Subquadratic Sparse Attention, it reads up to 384K tokens of text and images, returns a decision on 100K tokens in about a second, and—per vendor numbers—scores 61.7 on Decision Index 0.2.1 vs Jev's 57.9. Input costs $0.05/M tokens; output is free.

Subquadratic launches SubQ Snap: a 384K-context decision model for agent routing, tool picks and checks at $0.05/M input

Key Takeaways

  • 384K multimodal context (text + images), 12x Jev per vendor
  • Decision Index 0.2.1: 61.7 vs Jev 57.9 (vendor-reported)
  • 16 enterprise tasks: 67.6 vs 61.6 avg, leads 13/16; trails on When2Call by 7.6
  • Decision LCR (72K–115K multi-doc): 74.0 one-shot vs Jev 48.0 chunked
  • $0.05 per M input tokens, output free; ~1s for 100K tokens
Read full story
Linked Models & Agents:
⚡ SubQ Snap⚡ SubQ⚡ Jev🌐 Subquadratic🌐 TypeSafe

vLLM Semantic Router open-sources Decision 3.0: six multimodal decision models from 0.6B to 27B, #1 on Jev Decision Index in its own evaluation

On Oct 11 the vLLM Semantic Router (vllm-sr) team released the Decision 3.0 family (d3, d3-flash, d3-mini, d3-nano, d3-lite, d3-edge) on Hugging Face under Apache-2.0. Built on Qwen3.5/3.8, the models take text, images and video and return probabilities for choice, yes/no and score questions in one call without generating text. Vendor-reported: the 27B d3 scores 64.7 on Jev Decision Index 0.3.1, ahead of Perplexity Decider v1.1 (62.8) and Decision 2.0 (55.9), with a 55 ms median text latency on one AMD MI325X.

vLLM Semantic Router open-sources Decision 3.0: six multimodal decision models from 0.6B to 27B, #1 on Jev Decision Index in its own evaluation

Key Takeaways

  • Six sizes: d3-edge 0.59B, d3-lite 0.85B, d3-nano 2.2B, d3-mini 4.5B, d3-flash 8.4B, d3 26.1B, all Apache-2.0 (HF collection)
  • Vendor-reported Jev Decision Index 0.3.1: d3 64.7 vs Perplexity Decider v1.1 62.8, Jev 60.1, Decision 2.0 55.9
  • Vision Index 0.3.1: d3 71.6 vs Perplexity Decider v1.1 70.6 and JEV-27B-VL 69.6
  • Median latency on one AMD MI325X, batch 1: d3 55 ms text / 273 ms image / 553 ms 10-second video; d3-edge 6.7 ms text
  • No text generation: every option gets a probability, and several Choice / Yes-No / Score questions share one call
Read full story
Linked Models & Agents:
⚡ Decision 3.0⚡ d3⚡ D3 Flash⚡ D3 Edge⚡ Qwen3.5⚡ Qwen3.8🌐 vLLM🌐 vLLM Semantic Router

Vega open-sources a physics-based typed decision model: frozen Qwen3.5-0.8B plus a 57 MB engine that rolls a ball into calibrated answers

Indie developer Nandakishor M open-sourced Vega (pip package vegaml, Apache 2.0): a frozen Qwen3.5-0.8B (4B also available) only reads, while a 57 MB trained engine models each allowed answer as a valley and rolls a damped ball into one, returning calibrated probabilities, conformal answer sets and an abstain flag. 73,728-token context and image input. The author's own paired tests beat hosted Jev 1.13.0 on tasks like phishing screening, while admitting it trails on reranking and multi-step reasoning.

Vega open-sources a physics-based typed decision model: frozen Qwen3.5-0.8B plus a 57 MB engine that rolls a ball into calibrated answers

Key Takeaways

  • Size: 0.8B engine is 14.3M params / 57 MB with a 0.84M-param task adapter; the 4B engine is 124 MB
  • Author-reported typed-decisions test (2,050 items): 0.763 (0.8B + adapter) and 0.803 (4B), at 22 ms / 28 ms per decision
  • Phishing, 800 emails: Vega 75.4 acc, 252/400 caught vs Jev 1.13.0 61.9, 99/400 (author's paired run, McNemar p=3e-11)
  • Median latency 267 ms on a T4 vs 591 ms hosted Jev; MMMU-Pro only 0.240, so not for university-level reasoning
  • pip install vegaml; model card and a live Hugging Face Space are available
Read full story
Linked Models & Agents:
⚡ Vega 0.8B⚡ Vega 4B⚡ Qwen3.5-0.8B⚡ Jev 1.13.0🌐 Nandakishor M

Jev maker TypeSafe AI raises $870M Series A at $7.5B valuation led by a16z, less than a month after Jev's launch

TypeSafe AI announced an $870M Series A at a $7.5B valuation on Oct 9, led by a16z with Sequoia and existing investor DCVC; Martin Casado joins the board. Its 'System One' decision model Jev launched Sept 15 and returns calibrated, typed decisions instead of text. TypeSafe says a third of the Fortune 500 use it; a16z's post says 25% — the figures differ.

Jev maker TypeSafe AI raises $870M Series A at $7.5B valuation led by a16z, less than a month after Jev's launch

Key Takeaways

  • $870M Series A at a $7.5B valuation, led by a16z with Sequoia and DCVC; Martin Casado joins the board
  • Jev launched Sept 15, 2026 — roughly 3.5 weeks before the round (TechCrunch)
  • a16z claims Jev generated 1 trillion tokens within 3 days of launch
  • Enterprise adoption claims differ: TypeSafe says a third of the Fortune 500, a16z says 25% — both self-reported
  • TypeSafe promises more machine-native models and enterprise features; docs at docs.typesafe.ai
Read full story
Linked Models & Agents:
ADSponsored

Liquid AI open-sources Open d1: d1-3B and d1-omni-600M decision models answer in one forward pass, 8 ms on RTX 4090

Liquid AI released two open-weight multimodal decision models: d1-3B (text+vision) and the experimental d1-omni-600M (text+image or text+audio). Instead of generating tokens they answer in a single forward pass. d1-3B scores 48.57 on Decision Index v0.2.1 (public split), first among sub-10B models and on par with the 12x larger Decider 35B-A3B, and answers in 8 ms on an RTX 4090 and 50 ms on a Jetson Orin Nano, with day-one llama.cpp support.

Liquid AI open-sources Open d1: d1-3B and d1-omni-600M decision models answer in one forward pass, 8 ms on RTX 4090

Key Takeaways

  • d1-3B: 48.57 on Decision Index v0.2.1 public split, #1 under 10B, on par with Decider 35B-A3B; d1-omni-600M: 15.95
  • Text benchmark mean: d1-3B 82.9 vs Decider 4B 81.1; d1-omni-600M 78.4 vs Decider 2B 77.1 (Civil Comments 95.8)
  • Single-question latency: 8 ms RTX 4090, 9 ms MI325X, 16 ms Jetson AGX Thor, 30 ms Apple M5 Pro, 50 ms Jetson Orin Nano
  • Packed throughput: 475 states/s on RTX 4090, 1,106/s on MI325X; three questions cost ~1.3x one
  • Weights on Hugging Face (incl. GGUF and w8a8), LFM Open License v1.0, day-one llama.cpp and NVFP4 support
Read full story
Linked Models & Agents:
⚡ d1-3B⚡ d1-omni-600M⚡ LFM2.5-VL-3B🌐 Liquid AI🌐 NVIDIA

Engram: Pre-Registered Agent Memory Trial Shows Raw Turn Selection Matches LLM Fact Extraction at 3,061x Lower Cost

Conversational memory for LLM agents traditionally divides into two opposing camps: expensive pipeline extraction that distills dialogues into structured factual memory stores versus raw conversational turn retrieval. Literature has reported contradictory findings. Researchers conducted a pre-registered, double-blind controlled study on held-out LoCoMo and LongMemEval benchmarks (arXiv:2609.34227). The investigation reveals that under constrained context budgets, selecting raw conversational turns via a lightweight typed decision model (Jev) is statistically non-inferior to full LLM fact extraction pipelines (95% one-sided bound -3.0 points vs. -5 margin)—while reducing write-time computational costs by a massive 3,061 times. Furthermore, the authors resolve literature contradictions by proving that reranking gains scale inversely with token budgets, while aggressive reranking degrades an agent's correct abstention reliability. All study protocols, data, and code are open-sourced at github.com/ris3abh/Engram.

Key Takeaways

  • Presents Engram, the first pre-registered double-blind study testing raw-turn selection against LLM fact extraction for agent memory
  • Shows raw turns selected via typed decision model Jev are statistically non-inferior to LLM fact extraction at 3,061x lower write cost
  • Proves reranking gains decay sharply as token budgets expand, while aggressive reranking degrades an agent's correct abstention rate
Read full story
Linked Models & Agents:

llama.cpp ships Decision Models: /v1/systemone scores options in one forward pass (Julia-1, Laya, Kev-4B, lev, OpenJev)

On 2026-10-02 ggml-org announced llama.cpp server support for Decision Models via /v1/systemone (PR #29818, merged 2026-10-02T09:56Z). Send a state plus typed questions; get option probabilities in one forward pass. Day-0 models: Julia-1, Laya, Kev-4B, lev, OpenJev (vision). Cloudflare Clef is planned next.

llama.cpp ships Decision Models: /v1/systemone scores options in one forward pass (Julia-1, Laya, Kev-4B, lev, OpenJev)

Key Takeaways

  • Official post 2026-10-02 + merged PR #29818 (2026-10-02T09:56Z, +2139/−15)
  • Endpoint POST /v1/systemone with choice/score/noul; probabilities + confidence; output_tokens=0
  • Day-0 GGUFs: Julia-1 / Laya / Kev-4B / lev / OpenJev; median ~3–43 ms/question on RTX PRO 6000 (blog table)
  • Distinct from Ollama SystemOne & Cloudflare Clef hosting; Clef listed as next in llama.cpp
  • Start: llama serve -hf ggml-org/Kev-4B-GGUF then curl /v1/systemone
Read full story
Linked Models & Agents:
⚡ Julia 1⚡ laya⚡ Kev 4b⚡ lev⚡ openjev🌐 ggml-org🌐 huggingface

Cloudflare open-sources Clef & Clef-flash decision models on Workers AI — 209ms / 38.8ms median

@Cloudflare (2026-10-01, #BirthdayWeek) launched its first in-house decision models Clef (27B) and Clef-flash (9B): hosted on Workers AI, Apache 2.0 weights, Jev System One–compatible; official blog cites ~2.5× / 13× median latency vs Jev and 2.2s vs 4.7s in a threat-intel Browser Run workflow.

Cloudflare open-sources Clef & Clef-flash decision models on Workers AI — 209ms / 38.8ms median

Key Takeaways

  • Primary: Cloudflare 2026-10-01 → Clef blog
  • Median latency (43 runs): Clef 209.3 ms, Clef-flash 38.8 ms vs Jev 524.1 ms (~2.5× / 13×)
  • Quality: BFCL 98.47/98.76; BANKING77 94.20; CLINC150+OOS 97.43; Clef family tops 7/10 decision benches
  • Shape: Qwen backbone + non-AR schema scoring; 64K ctx; vision; @cf/cloudflare/clef / clef-flash; $0.24 / $0.09 per M input tokens
  • Ship: Workers AI binding/REST; weights on HF; RL fine-tune via design-partner form
Read full story
Linked Models & Agents:
⚡ Cloudflare Clef⚡ Cloudflare Clef Flash🌐 cloudflare

Ollama Python 0.6.3: native systemone() for Decision Models; think accepts model-defined levels

Official Ollama Python client v0.6.3 shipped 2026-09-29: adds ollama.systemone() matching server v0.35.0 /v1/systemone Decision Models (choice/noul/score); relaxes think to string levels; fixes multi-tool examples and case-insensitive image extensions. Requires Ollama ≥0.35.0 plus local decision models such as nimble/tev1.

Ollama Python 0.6.3: native systemone() for Decision Models; think accepts model-defined levels

Key Takeaways

  • Release v0.6.3 on 2026-09-29; ~6 commits vs v0.6.2 including examples/systemone.py
  • New ollama.systemone(model, state, questions) batches choice/noul/score Decision Model queries
  • Needs Ollama server v0.35.0+ and a local decision model (nimble/tev1)
  • think accepts string levels for model-defined thinking (#697/#744)
  • Install: pip install -U ollama==0.6.3
Read full story
Linked Models & Agents:
⚡ nimble⚡ tev1🤖 ollama🌐 Ollama