AI Coding Live News

Artificial Analysis Launches Decision Index v2: New Calibration-Aware Decision Score, 45% Private Data, Drex Max v1.1 Narrowly Leads Decision Models at 73

On November 8 (morning of November 9 in Singapore), independent evaluator Artificial Analysis released version 2 of its Decision Index for decision models. The headline metric is now a Decision Score that rewards both correct answers and well-calibrated confidence, the private-data share rises from 25% in v1 to 45%, and two new evaluations are added: AA-Paperclip with 1,500 private documents and AA-Symmetry for answer consistency. Among decision models, Nace AI's Drex Max v1.1 and Fastino Labs' GLiDE v1.2 both score 73, with Drex Max narrowly ahead, and Base Labs' Mammoth 27B scores 72. General LLMs score higher, with Claude Haiku 5.5 (Max) at 77 and GPT-6 Luna (Max) at 76, but cost $6,240 and $1,530 per 1M tasks versus $102 for Drex Max.

Artificial Analysis Launches Decision Index v2: New Calibration-Aware Decision Score, 45% Private Data, Drex Max v1.1 Narrowly Leads Decision Models at 73

Key Takeaways

  • New metric (official leaderboard): per-question score = 50 x (1 + c - (p - c)^2), equal overall to 50 x (1 + accuracy - Brier score); right answers always score above 50 and wrong ones below 50, with confidence spreading scores within each half
  • New weights: AA-Paperclip 30%, AA-Symmetry 15%, EvalSafe-O*NET-AA 15%, AA-Omniscience-Decision v1.1 15%, HLE-MultiChoice v1.1 15%, NVIDIA When2Call 10% (down from 25%); the saturated WildGuardTest was removed
  • Top decision models (vendor-run evaluation): Drex Max v1.1 73, GLiDE v1.2 73, Mammoth 27B 72; general LLMs Claude Haiku 5.5 (Max) 77 and GPT-6 Luna (Max) 76
  • Cost gap above 60x: Celeris-1.1 Decision $14 per 1M tasks, Drex Max v1.1 $102, Clef $859; GLiDE v1.2 bills a document's input for every question and costs $780, about 8x Drex Max
  • Speed: Celeris-1.1 Decision takes 56 ms per task and Elephant 9B 70 ms, versus 11.34 s for GPT-6 Luna (Max) and 32.65 s for Claude Haiku 5.5 (Max)
Read full story
Linked Models & Agents:

Kakao Open-Sources Kanana-2-v-decide-3b: 3.67B Multimodal Decision Model Returning Probabilities, Choices and Scores; Vendor Decision Index Avg 61.23

On 2026-11-06 Kakao open-sourced Kanana-2-v-decide-3b-2611 on Hugging Face (~3.67B), built on Kanana-2-v-3b: no text generation, only choice / noul / score with probabilities. Vendor: 72.50 on Kanana Decision Bench; 61.23 avg on Decision Index + Vision; mean <0.04s on one H200, claimed ~43x vs GPT-6 Luna. Commercial Kanana Open License.

Kakao Open-Sources Kanana-2-v-decide-3b: 3.67B Multimodal Decision Model Returning Probabilities, Choices and Scores; Vendor Decision Index Avg 61.23

Key Takeaways

  • Official: HF open weights kakaocorp/kanana-2-v-decide-3b-2611 (~3.67B), commercial Kanana Open License
  • Form: embedding similarity + softmax; choice / noul / score — no text generation
  • Vendor: 72.50 on Kanana Decision Bench; 61.23 avg on Decision Index + Vision
  • Vendor: mean <0.04s on one H200; claimed ~43x vs GPT-6 Luna
  • Try: transformers system_one / pipeline("decision") or HTTP System One server
Read full story
Linked Models & Agents:
⚡ Kanana-2-v-decide-3b-2611⚡ Kanana-2-v-3b⚡ GPT-6 Luna🤖 Agent decision / tool selection🌐 Kakao

Artificial Analysis Benchmarks Devin Fusion: Scoring 68.1 on Coding Agent Index While Slashing Task Cost by 31%

Artificial Analysis released an independent evaluation of Cognition's new coding agent, Devin Fusion. Moving beyond single-model execution, Devin Fusion employs an asymmetric multi-agent architecture pairing Claude Opus 5.5 (max) as the lead reasoning orchestrator alongside GPT-6 Luna (high) as a high-speed parallel worker. In the standardized Coding Agent Index, Devin Fusion achieved an elite score of 68.1 (matching Muse Code at 68.0 and rivaling Claude Code Sonnet 5.5 at 68.4). Crucially, the hybrid architecture slashes average task expense from $13.04 down to $9.01 (a 31% cost reduction) while shortening execution runtime from 65 to 55 minutes.

Artificial Analysis Benchmarks Devin Fusion: Scoring 68.1 on Coding Agent Index While Slashing Task Cost by 31%

Key Takeaways

  • Artificial Analysis independently benchmarked Devin Fusion, scoring 68.1 on the standardized Coding Agent Index
  • Pioneers asymmetric model collaboration: Claude Opus 5.5 orchestrates architecture while GPT-6 Luna executes parallel sub-tasks
  • Cuts per-task execution costs from $13.04 to $9.01 (a 31% savings) and trims average completion time from 65 to 55 minutes
  • Outperforms Claude Code with Opus 5.5 on DeepSWE v1.1 (72.6% vs 68.4%) and SWE-Atlas-QnA (69.6% vs 66.4%)
Read full story

Devin Fusion with an Opus 5.5 lead and GPT-6 Luna sidekick tops the Artificial Analysis Coding Agent Index at 68.1, at what Cognition says is 31% lower cost per task than Claude Code with Opus 5.5

Cognition said on October 19 that Devin Fusion, pairing Claude Opus 5.5 as the lead with GPT-6 Luna as the sidekick, scored 68.1 on the Artificial Analysis Coding Agent Index v1.5. Artificial Analysis's current data puts it first, but only 0.1 ahead of Muse Code with Muse Wonder Full at 68.0, effectively a tie; Antigravity CLI with Gemini 4 Argon is third at 63.8. Cognition says the pairing costs 31% less per task than Claude Code with Opus 5.5 (vendor-reported). Fusion ships in Devin CLI and Desktop.

Devin Fusion with an Opus 5.5 lead and GPT-6 Luna sidekick tops the Artificial Analysis Coding Agent Index at 68.1, at what Cognition says is 31% lower cost per task than Claude Code with Opus 5.5

Key Takeaways

  • 68.1 overall: DeepSWE v1.1 72.6, SWE-Atlas-QnA 69.6, Terminal-Bench v4 62.1, equally weighted (Artificial Analysis data).
  • Just 0.1 ahead of Muse Code with Muse Wonder Full (68.0); Antigravity CLI with Gemini 4 Argon 63.8, Codex with GPT-6.1 Sol (xhigh) 62.9.
  • Cost: Cognition says 31% lower per task than Claude Code with Opus 5.5 (vendor-reported).
  • Earlier, Fusion with Fable 5.1 + SWE-2 cut DeepSWE 1.1 cost per task from $14.63 to $7.88 (-46%) while scoring 63.1 vs 64.3.
  • Recommended pairing is Opus 5.5 + GPT-6 Luna, available by installing Devin CLI.
Read full story
ADSponsored

Inception launches Mercury 3 diffusion LLM: 1,068 tokens/s and 1M context, beating GPT-6 Luna and Haiku 5.5 on several benchmarks per the vendor

On October 19 Inception released Mercury 3, which it calls the most capable diffusion LLM (dLLM) to date. Per the vendor, it is more than 40x the size of Mercury 1, outputs 1,068 tokens/s, expands context from 260K (Mercury 2.5) to 1M tokens, and beats GPT-6 Luna and Claude Haiku 5.5 (both medium) on GPQA Diamond, IFBench, SWE-Bench Atlas and more. List price is $0.20/M input and $0.70/M output, 50% off at launch. It is live on the Inception API, OpenRouter, Baseten and Vercel AI Gateway with an OpenAI-compatible API. All scores are vendor-reported and not yet independently reproduced.

Inception launches Mercury 3 diffusion LLM: 1,068 tokens/s and 1M context, beating GPT-6 Luna and Haiku 5.5 on several benchmarks per the vendor

Key Takeaways

  • Speed: 1,068 tokens/s output; the vendor table lists GPT-6 Luna at ~130 and Haiku 5.5 at ~240 (vendor figures).
  • Scores: GPQA Diamond 89.23, IFBench 76.84, SWE-Bench Atlas 51.08, all above Luna and Haiku 5.5; but DeepSWE v1 at 46.31 trails Haiku 5.5 (51.62), and MRCR v2 also trails Haiku.
  • Scale and context: more than 40x the parameters of Mercury 1, with a 1M-token window (260K on Mercury 2.5).
  • Price: $0.20/M in and $0.70/M out list, 50% off at launch ($0.10/$0.35), cached input 90% off; new API keys get 100M free tokens.
  • Access: Inception API, OpenRouter, Baseten and Vercel AI Gateway, OpenAI-compatible as a drop-in replacement.
Read full story

GitHub Copilot updates HydraFusion and adds HydraFusion Max, with Claude Opus 5.5 and the GPT-6 family in its model pool

On 2026-10-14 GitHub updated HydraFusion, Copilot's multi-model orchestration feature, and added HydraFusion Max for harder tasks. The pool now includes Claude Opus 5.5, GPT-6 Astra, GPT-6.1 Sol and GPT-6 Luna; effort is tuned per stage (medium for drafts, high for review), Cascade gains a judging step, and Critique now inspects the workspace with tools using parallel critics. Both remain in research preview across VS Code, the Copilot app and Copilot CLI.

Key Takeaways

  • Pool: Claude Opus 5.5, GPT-6 Astra, GPT-6.1 Sol, GPT-6 Luna, chosen per workflow (GitHub Changelog)
  • Per-stage effort: medium for drafts, high for review (previously each model's default)
  • Cascade adds a judge that requests repair only when needed; Critique uses tools on the workspace plus parallel critics
  • Two tiers: HydraFusion (balanced) and HydraFusion Max (deepest reasoning, orchestration still minds tokens)
  • Available in VS Code, Copilot app and Copilot CLI on Pro, Pro+, Business and Enterprise with preview features enabled
Read full story

GPT-5.5 retires from ChatGPT, ChatGPT Work and Codex today: ChatGPT sign-in users must move to gpt-6-sol or gpt-6-luna, the API is unaffected

Per OpenAI's model docs, GPT-5.5 retires from ChatGPT, ChatGPT Work and Codex on all plans on 2026-10-14; the OpenAI API is not affected. Codex users on ChatGPT sign-in should pick gpt-6-sol (Plus, Pro, Business, Enterprise, Edu) or gpt-6-luna in the desktop app (Free, Go), with gpt-6.1-sol recommended for complex coding. Any config.toml, custom agent, scheduled task or script pinned to gpt-5.5 needs updating now.

Key Takeaways

  • Effective 2026-10-14: GPT-5.5 leaves ChatGPT, ChatGPT Work and Codex on every plan; the OpenAI API is unaffected
  • Replacements: gpt-6-sol for Plus/Pro/Business/Enterprise/Edu, gpt-6-luna in the desktop app for Free/Go (both 'when available')
  • For complex coding OpenAI recommends gpt-6.1-sol, near-Astra at 1/5 of Astra's standard price per OpenAI
  • Check 4 places: model in config.toml, codex exec -m, custom agents, scheduled tasks and scripts
  • Enterprise/Edu admins must enable newer models first; GPT-5.6 Sol/Terra/Luna remain available during the rollout
Read full story

OpenAI will remove GPT-4o, GPT-4o mini, GPT-4.1 and GPT-4.1 mini from the API on January 14, 2027, recommending gpt-6-luna

On Oct 14 OpenAI's API deprecations page announced that GPT-4o (2024-08-06 and 2024-11-20 snapshots), GPT-4o mini (2024-07-18), GPT-4.1 and GPT-4.1 mini (2025-04-14) will be removed from the API on January 14, 2027. Fine-tunes built on them shut down the same day, and the recommended replacement for all four is gpt-6-luna, listed at $0.10 input / $0.50 output per 1M tokens versus $2.50 / $10 for GPT-4o.

OpenAI will remove GPT-4o, GPT-4o mini, GPT-4.1 and GPT-4.1 mini from the API on January 14, 2027, recommending gpt-6-luna

Key Takeaways

  • Shutdown: January 14, 2027 (about 3 months' notice) for gpt-4o-2024-08-06, gpt-4o-2024-11-20, gpt-4o-mini-2024-07-18, gpt-4.1-2025-04-14 and gpt-4.1-mini-2025-04-14
  • Fine-tuned versions follow the base model's shutdown date; existing customers already lose new fine-tuning jobs on Jan 6, 2027
  • Standard price per 1M tokens (input/output): gpt-6-luna $0.10/$0.50, GPT-4o $2.50/$10, GPT-4.1 $2.00/$8.00, GPT-4.1 mini $0.40/$1.60, GPT-4o mini $0.15/$0.60
  • Monitor programmatically via the shutdown_date field on GET /v1/models
  • Second October deprecation wave: older snapshots such as gpt-4o-2024-05-13 and o4-mini shut down Oct 23; gpt-5.3-codex and gpt-5.1 go on Apr 1, 2027
Read full story
Linked Models & Agents:

OpenAI API shuts down 12 legacy models on Oct 23: o4-mini, o3-mini, gpt-4o-2024-05-13 and gpt-image-1 included, 12 days left to migrate

Per OpenAI's official Deprecations page, a batch of legacy snapshots deprecated on Apr 22 stops serving in the API on Oct 23, 2026: 12 snapshots and their aliases including gpt-3.5-turbo-0125, gpt-4-0613, gpt-4-turbo, gpt-4.1-nano, gpt-4o-2024-05-13, gpt-image-1, o1, o1-pro, o3-mini and o4-mini, plus five fine-tuned model families. Official substitutes are gpt-5.6-sol/terra/luna and gpt-image-2.5. The #keep4o campaign to preserve GPT-4o snapshots resurfaced on X today.

Key Takeaways

  • 12 snapshots plus aliases go dark together: o4-mini, o3-mini, o1, o1-pro, gpt-4-turbo, gpt-4, gpt-3.5-turbo aliases stop resolving (OpenAI Deprecations)
  • Shutdown date Oct 23, 2026 — 12 days away; announced Apr 22, meeting OpenAI's 6-month minimum for GA models
  • Substitutes: o4-mini / gpt-3.5 → gpt-5.6-terra; gpt-4 family / o1 / o3-mini / gpt-4o-2024-05-13 → gpt-5.6-sol; o1-pro → gpt-5.6-sol with reasoning.mode: pro; gpt-4.1-nano → gpt-5.6-luna
  • gpt-image-1 → gpt-image-2.5-sunburst or -flare; five fine-tuned families (ft-gpt-4, ft-gpt-3.5-turbo, ft-o4-mini, etc.) also shut down and must be retrained on new bases
  • Next wave: Dec 1 (gpt-image-1.5 / 1-mini) and Dec 11 (first-gen gpt-5 snapshots, o3, o3-pro)
Read full story
Linked Models & Agents:

Pine Computer launches a cloud computer built for AI agents: event-driven perception instead of screenshot polling; GPT-5.6 Luna hits 78.3% SaaS-Bench v1.1 checkpoint score vs 74.3% for Opus 5 + Claude Code at ~$1.02 model cost per task

On Oct 9 Pine AI released Pine Computer in private beta: cloud virtual computers plus a harness and runtime built for AI, driven by an API across browser, files and shell. Instead of repeated screenshots, the OS, browser and apps push change notifications to the model ("epoll for AI perception"). On SaaS-Bench v1.1 (106 tasks, 23 apps) GPT-5.6 Luna on Pine scored 78.3% on checkpoints vs 74.3% for Opus 5 + Claude Code, though its fully-resolved rate (27.4%) trails the latter (31.1%).

Pine Computer launches a cloud computer built for AI agents: event-driven perception instead of screenshot polling; GPT-5.6 Luna hits 78.3% SaaS-Bench v1.1 checkpoint score vs 74.3% for Opus 5 + Claude Code at ~$1.02 model cost per task

Key Takeaways

  • SaaS-Bench v1.1 checkpoint score: Pine + GPT-5.6 Luna 78.3% vs Opus 5 + Claude Code 74.3% vs GPT-5.6 Sol + Codex 71.1%
  • Fully resolved rate trails: 27.4% vs 31.1% (Claude Code) / 29.2% (Codex)
  • Model token cost per task: ~$1.02 vs $26.50 (Opus 5 + Claude Code) / $20.50 (GPT-5.6 Sol + Codex), excluding infrastructure
  • New computer boots in seconds, heavy state restores in ~15 s, paused ones resume in <1 s
  • Launch post: ~99.8K impressions, 250+ likes, 120 reposts; private beta waitlist only
Read full story
ADSponsored

GPT-6 rolls out to all of ChatGPT with Intelligent UI: interactive charts and in-chat tools, Sol for paid tiers and Luna for free

On Oct 7 OpenAI began rolling GPT-6 out globally in ChatGPT together with Intelligent UI: the model decides when to answer with diagrams, interactive charts, forms, tappable buttons or small in-chat tools (calculators, games, bill splitters) instead of plain text. Plus, Pro, Business and Enterprise get it first on GPT-6 Sol; Go and free users follow on Oct 8 on GPT-6 Luna. OpenAI says GPT-6 can stream partial answers while still thinking, cutting wait times by 44%.

Key Takeaways

  • Tiers: Plus / Pro / Business / Enterprise get GPT-6 Sol from Oct 7; Go and free get the more efficient GPT-6 Luna from Oct 8 (OpenAI announcement)
  • Answers while thinking: partial answers stream before reasoning finishes; OpenAI says wait times drop 44% and GPT-6 beat GPT-5.6 on hard web searches in internal tests (The Decoder)
  • Intelligent UI renders diagrams, interactive and editable charts, forms, tappable buttons and on-demand in-chat tools (savings calculator, retro game, bill splitter); users can dial visuals down (TechCrunch)
  • Safety: OpenAI says GPT-6 resists attempts to bypass its safety training better (The Verge)
  • Context: Google shipped a similar generative-interface feature for Gemini in May; ChatGPT now makes it a default for every user
Read full story

OpenAI opens the Decisions API public beta: POST /v1/decisions on gpt-6-luna returns typed predicate, choice and score answers ~10x faster than the Responses API, billed only for input at $0.10 per 1M tokens

Per the OpenAI API changelog, the Decisions API entered public beta on 2026-10-06 with gpt-6-luna: a dedicated POST /v1/decisions endpoint takes text/images plus a list of questions and returns typed predicate, choice or score answers with probabilities, about 10x faster than the Responses API. Billing is input-only at $0.10 per 1M tokens (no output or cache charges); ZDR and HIPAA are supported and GA is expected within weeks.

OpenAI opens the Decisions API public beta: POST /v1/decisions on gpt-6-luna returns typed predicate, choice and score answers ~10x faster than the Responses API, billed only for input at $0.10 per 1M tokens

Key Takeaways

  • Speed: typed answers about 10x faster than the Responses API (Decisions guide)
  • Price: input-only $0.10 per 1M tokens, no output or cache read/write fees; regular gpt-6-luna is $0.10 in / $0.50 out
  • 3 question types: predicate (0–1 probability), choice (value + probabilities + confidence), score (probability-weighted ordinal level)
  • Compliance: ZDR and HIPAA eligible, US and Europe (EEA + Switzerland) data residency; GA expected in weeks
  • Limits: gpt-6-luna only; images must be inline base64, no hosted URLs or file_id
Read full story
Linked Models & Agents:

FrugalEvo: Cost-Aware LLM-Guided Program Evolution Slashes Multi-Agent Optimization Costs by 97% with Prefix-Cache Reuse

LLM-guided evolutionary algorithms (such as AlphaEvolve) have achieved breakthrough results in computational optimization, including circle packing and systems tuning. However, existing methods optimize strictly over iteration counts rather than fiscal expenditure, burning dozens of dollars per task. Researchers from NUS, Stanford, and HKUST present FrugalEvo (arXiv:2610.03675), a cost-aware program evolution framework maximizing gain per dollar. FrugalEvo implements an asymmetric dual-LLM division of labor: a powerful, higher-cost LLM explores high-level solution concepts, while a cheap, high-speed LLM generates and iteratively refines concrete implementations. Additionally, FrugalEvo engineers prompt harnesses to maximize prefix KV-cache reuse across evolutionary generations. Across 10 mathematical optimization problems and ALE-Bench-Lite suites, FrugalEvo matches or outperforms OpenEvolve, EvoX, and SwarmResearch. On circle packing, FrugalEvo achieves SOTA performance using GLM-5.3/Flash for only $0.55 and GPT-5.6 Terra/Luna for $1.68—slashing costs by up to 99% compared to conventional $50 multi-agent baselines.

FrugalEvo: Cost-Aware LLM-Guided Program Evolution Slashes Multi-Agent Optimization Costs by 97% with Prefix-Cache Reuse

Key Takeaways

  • Pioneers FrugalEvo, the first cost-aware LLM program evolution framework maximizing optimization gain per dollar spent
  • Pairs an asymmetric dual-LLM hierarchy with prefix KV-cache reuse, establishing the new Budget-Aware AUC (BA-AUC) benchmark
  • Achieves SOTA on circle packing for $0.55-$1.68, outperforming $50 multi-agent baselines like CORAL and SwarmResearch
Read full story

Zed 1.21.0: Agent Panel BYOK for Claude Opus 5.5 and GPT-6 Astra/Sol/Luna; prevent idle sleep on long agent turns

Zed Industries shipped editor Zed v1.21.0 on 2026-09-23. AI: Agent Panel BYOK for Claude Opus 5.5 (Anthropic) and GPT-6 Astra/Sol/Luna (OpenAI); SuperGrok sign-in for Grok models; DeepSeek Flash 4.1; Z.ai GLM via Mistral provider; agent.prevent_idle_sleep on by default so long agent turns do not idle-sleep the machine. Also: language-server command picker, showDocument open file/URL, faster syntax/Markdown code-block rendering, ACP compatibility and async task wakeup improvements.

Zed 1.21.0: Agent Panel BYOK for Claude Opus 5.5 and GPT-6 Astra/Sol/Luna; prevent idle sleep on long agent turns

Key Takeaways

  • Shipped: v1.21.0 — zed.dev/releases/stable
  • BYOK: Opus 5.5 (Anthropic) + GPT-6 Astra/Sol/Luna (OpenAI)
  • Default agent.prevent_idle_sleep for long agent turns
  • Also: SuperGrok, DeepSeek Flash 4.1, Z.ai GLM via Mistral; ACP improvements
  • Docs: AI overview, Agent Panel, LLM providers
Read full story

Vercel AI SDK @ai-sdk/openai 4.0.78: GPT-6 Sol/Luna allow reasoningEffortUpdate 'none'

Vercel AI SDK shipped @ai-sdk/[email protected] on 2026-09-26: request-level and positioned system-message reasoningEffortUpdate now accept 'none' so GPT-6 Sol/Luna conversations can turn reasoning off mid-thread. Updates are validated against each model’s supported efforts—unsupported request-level updates warn and omit; unsupported historical/message-level updates reject. Companion @ai-sdk/[email protected] and @ai-sdk/[email protected] pick up the dependency.

Vercel AI SDK @ai-sdk/openai 4.0.78: GPT-6 Sol/Luna allow reasoningEffortUpdate 'none'

Key Takeaways

  • Shipped: @ai-sdk/[email protected] / npm 4.0.78
  • Feature: reasoningEffortUpdate 'none' for GPT-6 Sol/Luna (#21518)
  • Validation: warn+omit unsupported request-level; reject unsupported historical updates
  • Companions: Azure 4.0.82, Bedrock 5.0.97; see OpenAI provider docs
  • Install: npm i @ai-sdk/[email protected]
Read full story