AI Coding Live News

Sarvam Releases Prism, an Open-Weight Decision Model Built on Sarvam 105B That Returns Calibrated Option Probabilities in About 44 ms, Apache 2.0

Indian AI company Sarvam released Sarvam Prism on November 3, a "System One" decision model for enterprise workflows: given a context and questions with fixed answer options, it returns a probability for every option in a single forward pass instead of generating text. Sarvam says that across the 25 decision models it tested, Prism averages 71.8 over three indices with a median response time of 44 ms on one B200, the highest score under 100 ms, and scores 82.5 on its Indian-language benchmark. Weights are on Hugging Face under Apache 2.0, with a hosted API as well. All scores are Sarvam's own measurements.

Sarvam Releases Prism, an Open-Weight Decision Model Built on Sarvam 105B That Returns Calibrated Option Probabilities in About 44 ms, Apache 2.0

Key Takeaways

  • Trained on the Sarvam 105B (105B-10B MoE) base; it only outputs option probabilities, so the answer is always one of the given options.
  • Vendor-reported indices: Jev Decision Index 67.0, Sarvam's recreation of the Artificial Analysis decision index 65.9, internal Indian-language benchmark 82.5, average 71.8; Perplexity Decider v1.2 averages 68.0 at about 117 ms.
  • Calibration: on English answers at 90%+ confidence it expects 3.3% errors and makes 2.2%; in Indian languages 5.4% expected vs 4.4% actual, while rivals underestimate errors by 1.5x to 4.8x.
  • By sorting options into a fixed order before scoring, it changed 0 of 2,000 answers across four shuffled option orders.
  • On 700 recorded agent runs it judges correctly 78.5% of the time overall, vs 70.7% for Claude Haiku 5.5.
  • Self-hosting needs one FP8-capable GPU with about 120 GB free memory (such as B200 or H200) and about 106 GB of disk for weights.
Read full story
Linked Models & Agents:
⚡ Sarvam Prism⚡ Sarvam 105B⚡ Perplexity Decider v1.2⚡ Jev 1.14⚡ Microsoft-Decision-1⚡ Claude Haiku 5.5🌐 Sarvam

Cloudflare launches Clairic, a System One extraction model that returns typed values, dates and forecasts with confidence in one forward pass, in preview on Workers AI at $0.10 per million input tokens

On October 19 Cloudflare released a preview of Clairic, a "System One extraction model". Instead of generating tokens, it uses one parallel forward pass to extract, compute, estimate and forecast typed values from text or up to 4 images, with confidence, character spans and a null probability for each answer, returning null when a value is missing. It is live on Workers AI as @cf/cloudflare/clairic; the docs list a 64K context, vision support and $0.10 per million input tokens with no output charge. In Cloudflare's example, a Clairic+Clef+GLM-5.3 cascade ran about 3.2x faster and about 49% cheaper than GLM-5.3 alone (company figures). Open weights are planned later.

Cloudflare launches Clairic, a System One extraction model that returns typed values, dates and forecasts with confidence in one forward pass, in preview on Workers AI at $0.10 per million input tokens

Key Takeaways

  • Pricing and specs: $0.10 per million input tokens, no output charge, 65,536-token context, text plus up to 4 images (official docs).
  • Output types: text, number, date/time, duration, list, estimate, forecast; each answer carries confidence and p_null, and missing values return null.
  • Cascade test: Clairic to Clef to GLM-5.3 took 19.3 s vs 61.7 s, about 3.2x faster; $6,032 vs $11,740 per million claims, about 49% cheaper (company figures).
  • Forecast example: 21-day TSA checkpoint forecast averaged 3.3% error, with 17 of 21 days inside the 80% interval.
  • Limits: long arithmetic chains and multi-row aggregation are not reliable yet; it is a preview checkpoint with no date for open weights.
Read full story
Linked Models & Agents:
⚡ clairic⚡ clef⚡ GLM-5.3🌐 cloudflare

Reading Right, Acting Wrong: CMU Diagnoses Why Fast System One Models Stumble in Autonomous Agent Loops

In production agentic loops, fast single-pass 'System 1' models are favored for latency-sensitive tool selection and interface actions. When these models fail, engineers cannot easily diagnose whether the agent misperceived environmental observations or misjudged its subsequent action. Researchers from Carnegie Mellon University (CMU) introduced a behavioral diagnostic benchmark across 17 fast models and frontier reasoning baselines, pairing next-action queries with independent factual probes about the state. The results expose a striking systemic pattern: the vast majority of erroneous actions follow completely accurate perception, with error concentration increasing in more accurate models. The true failure mode lies not in reading facts, but in synthesizing them into the next programmatic sub-goal.

Reading Right, Acting Wrong: CMU Diagnoses Why Fast System One Models Stumble in Autonomous Agent Loops

Key Takeaways

  • Unmasking agent failure modes: CMU demonstrates that next-action failures are rarely caused by perceptual hallucinations; most errors occur after flawlessly reading state facts
  • Higher accuracy exacerbates synthesis gaps: as base model accuracy increases, a higher percentage of its remaining failures stem from reasoning synthesis rather than perception
  • Engineering remediation: identifies sub-goal derivation as the missing link; composing the model's own independent factual readings with deterministic code resolves the failure
Read full story
Linked Models & Agents:

Jev maker TypeSafe AI raises $870M Series A at $7.5B valuation led by a16z, less than a month after Jev's launch

TypeSafe AI announced an $870M Series A at a $7.5B valuation on Oct 9, led by a16z with Sequoia and existing investor DCVC; Martin Casado joins the board. Its 'System One' decision model Jev launched Sept 15 and returns calibrated, typed decisions instead of text. TypeSafe says a third of the Fortune 500 use it; a16z's post says 25% — the figures differ.

Jev maker TypeSafe AI raises $870M Series A at $7.5B valuation led by a16z, less than a month after Jev's launch

Key Takeaways

  • $870M Series A at a $7.5B valuation, led by a16z with Sequoia and DCVC; Martin Casado joins the board
  • Jev launched Sept 15, 2026 — roughly 3.5 weeks before the round (TechCrunch)
  • a16z claims Jev generated 1 trillion tokens within 3 days of launch
  • Enterprise adoption claims differ: TypeSafe says a third of the Fortune 500, a16z says 25% — both self-reported
  • TypeSafe promises more machine-native models and enterprise features; docs at docs.typesafe.ai
Read full story
Linked Models & Agents:
ADSponsored

llama.cpp ships Decision Models: /v1/systemone scores options in one forward pass (Julia-1, Laya, Kev-4B, lev, OpenJev)

On 2026-10-02 ggml-org announced llama.cpp server support for Decision Models via /v1/systemone (PR #29818, merged 2026-10-02T09:56Z). Send a state plus typed questions; get option probabilities in one forward pass. Day-0 models: Julia-1, Laya, Kev-4B, lev, OpenJev (vision). Cloudflare Clef is planned next.

llama.cpp ships Decision Models: /v1/systemone scores options in one forward pass (Julia-1, Laya, Kev-4B, lev, OpenJev)

Key Takeaways

  • Official post 2026-10-02 + merged PR #29818 (2026-10-02T09:56Z, +2139/−15)
  • Endpoint POST /v1/systemone with choice/score/noul; probabilities + confidence; output_tokens=0
  • Day-0 GGUFs: Julia-1 / Laya / Kev-4B / lev / OpenJev; median ~3–43 ms/question on RTX PRO 6000 (blog table)
  • Distinct from Ollama SystemOne & Cloudflare Clef hosting; Clef listed as next in llama.cpp
  • Start: llama serve -hf ggml-org/Kev-4B-GGUF then curl /v1/systemone
Read full story
Linked Models & Agents:
⚡ Julia 1⚡ laya⚡ Kev 4b⚡ lev⚡ openjev🌐 ggml-org🌐 huggingface

Cloudflare open-sources Clef & Clef-flash decision models on Workers AI — 209ms / 38.8ms median

@Cloudflare (2026-10-01, #BirthdayWeek) launched its first in-house decision models Clef (27B) and Clef-flash (9B): hosted on Workers AI, Apache 2.0 weights, Jev System One–compatible; official blog cites ~2.5× / 13× median latency vs Jev and 2.2s vs 4.7s in a threat-intel Browser Run workflow.

Cloudflare open-sources Clef & Clef-flash decision models on Workers AI — 209ms / 38.8ms median

Key Takeaways

  • Primary: Cloudflare 2026-10-01 → Clef blog
  • Median latency (43 runs): Clef 209.3 ms, Clef-flash 38.8 ms vs Jev 524.1 ms (~2.5× / 13×)
  • Quality: BFCL 98.47/98.76; BANKING77 94.20; CLINC150+OOS 97.43; Clef family tops 7/10 decision benches
  • Shape: Qwen backbone + non-AR schema scoring; 64K ctx; vision; @cf/cloudflare/clef / clef-flash; $0.24 / $0.09 per M input tokens
  • Ship: Workers AI binding/REST; weights on HF; RL fine-tune via design-partner form
Read full story
Linked Models & Agents:
⚡ Cloudflare Clef⚡ Cloudflare Clef Flash🌐 cloudflare
C
Confident AI@confident-ai·
👀73
🔥90

DeepEval 4.2: Jev for LLM-as-judge decisions at ~$0.042/M input tokens and ~100ms

Confident AI’s deepeval 4.2.x (notes for 4.2.2/4.2.4; PyPI at 4.2.6) wires TypeSafe Jev into LLM-as-a-judge: evaluation LLMs still handle language tasks, while closed verdicts go to System One for typed decisions with calibrated probabilities. Claimed decision-stage pricing is about $0.042 per million input tokens with no output charge, ~100ms typical latency, and batched independent questions. Faithfulness, GEval, DAGMetric, and Classifiers are integrated; enable via deepeval set-mode experimental plus typesafe-sdk—missing keys fail loudly instead of silent fallback.

DeepEval 4.2: Jev for LLM-as-judge decisions at ~$0.042/M input tokens and ~100ms

Key Takeaways

  • Notes: python-v4.2.4; blog Introducing Jev for Evals; PyPI deepeval 4.2.6
  • Official: ~$0.042/M input tokens for decisions, no output charge; ~100ms typical; batch independent questions
  • Faithfulness/GEval/DAGMetric keep language work on the judge LLM; closed verdicts use Jev Noul/Choice/Score
  • New Classifiers for categorical labels (e.g. RefusalClassifier)
  • Opt-in: deepeval set-mode experimental + typesafe-sdk + TYPESAFE_API_KEY (loud failure if missing)
Read full story
Linked Models & Agents:

HarnessRouter open-sources Unified Harness Protocol: one API for Codex, Claude Code, Hermes, and more

@akshay_pachaar highlighted HarnessRouter (github.com/HarnessRouter/harnessrouter, Apache-2.0): an “OpenRouter for agent harnesses” implementing the Unified Harness Protocol (UHP) so Codex, Claude Code, Hermes, DeepSeek Harness, System One (Jev), and 9+ other harnesses share one API for sessions, streaming, files, cancellation, and failure handling—self-hosted with your own keys.

Key Takeaways

  • Open-source github.com/HarnessRouter/harnessrouter (Apache-2.0); site harnessrouter.ai.
  • Unified Harness Protocol: one API for sessions, streaming, files, cancellation, and failures.
  • Supports Codex, Claude Code, Hermes, DeepSeek Harness, System One (Jev), and 9+ other harnesses.
Read full story

Open-source Jev Android Super: accessibility-tree phone agent, ~400ms decisions, MIT

@SomeshSampat123 released open-source Android agent jev-android-super (github.com/SomeshSampat2/jev-android-super, MIT): an accessibility service indexes tappable elements; one Jev (System One) call decides goal status and tap/type targets, then deterministic gestures run—no screenshot vision model. Demo “Open YouTube & subscribe” took ~32s / 17 steps; glowing border, notification STOP, paywall blocks, and on-device keys are called out.

Key Takeaways

  • Accessibility-tree state plus Jev decisions; no screenshot vision model.
  • Demo completed YouTube subscribe in ~32s / 17 steps; ~400ms per decision.
  • MIT open source; STOP control, paywall blocks, and on-device keys.
Read full story
Linked Models & Agents:

mcp-typesafe: Rust MCP server exposing TypeSafe Jev System One tools to any agent

Community release mcp-typesafe (github.com/sf-stav/mcp_typesafe): an unofficial Rust MCP server that exposes TypeSafe System One / Jev structured judgments (choice/score) plus higher-level filter/rank/classify/choose-one and stability tools to any MCP client. It targets bulk triage without burning LLM context and calibrated probabilities instead of prose confidence; most calls are ~100ms. stdio and SSE transports, TypeSafe API key required, single static binary.

Key Takeaways

  • Unofficial Rust MCP exposing Jev/System One structured judgments to any agent.
  • Bulk filter/rank/classify/choose-one plus stability sampling; most calls ~100ms.
  • stdio + SSE; TypeSafe API key required; single static binary.
Read full story
Linked Models & Agents:
ADSponsored

OpenRouter lists TypeSafe Jev in beta: typed probabilistic decisions, no JSON prompting

OpenRouter announced TypeSafe Jev is available in beta. Jev is framed as a System One model: given app state plus a typed question, it returns a typed decision with a probability—no JSON prompting, parsing layer, or schema validation. Developers can now route Jev through OpenRouter in addition to the earlier Vercel AI Gateway path.

Key Takeaways

  • Jev is live in beta on OpenRouter for typed probabilistic decisions over app state, not free-form text.
  • No JSON prompting, parsing, or validation layer is required, cutting structured-output friction for agents.
  • Complements the earlier Vercel AI Gateway listing so teams can route the same decision model across gateways.
Read full story
Linked Models & Agents: