AI Coding Live News

Microsoft Open-Sources Mage-VL-Cowork, a 4B Computer-Use Agent That Chooses Between Clicking the GUI and Running Bash, Scoring 66.0% on OSWorld-Verified

On October 30, Microsoft's Mage team released Mage-VL-Cowork on Hugging Face under Apache-2.0: a 4B multimodal computer-use agent in which a single model decides at every step whether to act through screenshots and GUI clicks (computer_use) or through bash and Python in a terminal, with no external orchestrator. Microsoft reports a two-run average of 66.0% on OSWorld-Verified (361 tasks, 50-step budget), above Qwen3.6-27B at 63.9% but below the 9B SCALECUA-Qwen3.5-9B at 68.7%.

Microsoft Open-Sources Mage-VL-Cowork, a 4B Computer-Use Agent That Chooses Between Clicking the GUI and Running Bash, Scoring 66.0% on OSWorld-Verified

Key Takeaways

  • 4B parameters, built on Mage-VL (Mage-ViT vision encoder plus Qwen3-4B-Instruct-2507); about 9.48 GB of bf16 weights under Apache-2.0.
  • On OSWorld-Verified, two independent runs scored 65.33% and 66.75% for a 66.0% average; 87.5% on operating-system tasks and 62.7% on multi-app workflows.
  • In Microsoft's side-by-side, a LibreOffice Calc chart task took 39 seconds (6 steps) via Python in the terminal, versus 9:56 (39 steps) for GUI-only Qwen3.6-27B.
  • Online RL adds 10.16 points over hybrid SFT while cutting mean model calls by 13.0% and output tokens by 25.4%.
  • Training data came from Mage-CUA-Forge, which synthesized about 294K desktop and web tasks across 6,915 skills and cut per-task generation cost from $0.906 to $0.158.
Read full story
Linked Models & Agents:
⚡ Mage-VL-Cowork⚡ Mage-VL⚡ Qwen3-4B⚡ Qwen3.6-27B🌐 Microsoft

Meituan ships LongCat-2.5, a 1.6T-parameter (about 48B active) native multimodal agentic model, with API pricing of $0.30/$1.20 per 1M tokens

On Nov 2 Meituan's LongCat team listed LongCat-2.5 in its API platform change log as the full release of September 25's LongCat-2.5-Preview. The official technical blog says it has 1.6 trillion total parameters with about 48 billion activated per token, builds on LongCat-2.0 with stronger native visual understanding and agentic coding, and was trained and served with W4A4 inference on domestic AI accelerators. Vendor-reported scores include 88.4 on Terminal Bench v2.1, 38.5 on Terminal Bench v4.0, 91.9 on BrowseComp and 83.1 on MCP Atlas. The API speaks both OpenAI and Anthropic formats with a 1M-token context and up to 128K output tokens, at a limited-time price of $0.30 per 1M uncached input tokens, $0.006 cached input and $1.20 output.

Meituan ships LongCat-2.5, a 1.6T-parameter (about 48B active) native multimodal agentic model, with API pricing of $0.30/$1.20 per 1M tokens

Key Takeaways

  • Scale: a 1.6-trillion-parameter MoE with about 48B active per token, a 1M-token context and up to 128K output tokens (official blog, API docs)
  • Code agents (vendor-reported): Terminal Bench v2.1 88.4 (Claude Opus 5 89.1, GPT-5.6-Sol 88.8), Terminal Bench v4.0 38.5 (GPT-5.6-Sol 37.3, Claude Opus 5 53.9), DeepSWE v1.1 64.6
  • General agents (vendor-reported): BrowseComp 91.9, MCP Atlas 83.1, AutomationBench v1.0.6 51.8, HLE with tools 63.1; AutomationBench jumps from 15.8 on LongCat-2.0
  • Pricing: limited-time $0.30 per 1M uncached input tokens, $0.006 cached input and $1.20 output (pricing page)
  • Engineering: W4A4 inference raises prefill throughput 43.3% and decode throughput 42.77% over a W8A8 baseline; FSDP gives 86% higher per-device throughput than DDP in long-sequence SFT
Read full story

SemiAnalysis releases GDPx, an agentic benchmark of 206 tasks across 11 high-value domains where the top model, Claude Opus 5.5, scores just 12%

On Nov 2, semiconductor and AI research firm SemiAnalysis released GDPx, a benchmark of agentic capability across 11 domains: chip design, cybersecurity, biology, finance, legal, quant trading, recursive self-improvement (RSI), hardware design, materials science, alignment and software engineering. Its 206 tasks were built by 14 specialist data partners, with SemiAnalysis doing final QA. On the official leaderboard Claude Opus 5.5 leads at 12.0%, followed by Gemini 4 Carbon at 10.9% and GPT-6 Astra at 9.6%; nearly every model scores 0 on finance and legal. SemiAnalysis says safety classifiers drag down Opus 5.5 and GPT-6 Astra, and plans a new version every 3–6 months. All scores are as reported by SemiAnalysis.

SemiAnalysis releases GDPx, an agentic benchmark of 206 tasks across 11 high-value domains where the top model, Claude Opus 5.5, scores just 12%

Key Takeaways

  • Scale: 11 domains, 14 data partners and 206 tasks, with a default time limit of 8 hours per task (GDPx site)
  • Leaderboard (as reported by SemiAnalysis): Claude Opus 5.5 12.0%, Gemini 4 Carbon 10.9%, GPT-6 Astra 9.6%, Muse Wonder Full 9.0%, Claude Fable 5.1 8.5%, GPT 6.1 Sol 8.4%, Claude Sonnet 5.5 8.2%
  • Lower tier and open weights: DeepSeek 4.1 Flash 1017 5.4%, GPT-6 Luna 5.1%, Grok 4.7 3.9%, GLM 5.3 2.7%; almost every model scores 0 on finance and legal
  • Method: each model runs in its native harness where one exists (Claude Code for Opus, Codex for Astra, Antigravity for Carbon), otherwise OpenCode; the headline is pass@1 over three attempts with all domains weighted equally (SemiAnalysis blog)
  • By domain: Opus 5.5 wins quant trading, hardware and chip design; Gemini 4 Carbon wins biology and software engineering; GPT-6 Astra wins RSI and materials science; Muse Wonder Full is the strongest cyber model
Read full story

Artificial Analysis releases AA-Omniscience v1.1: 3,000 refreshed questions and a calibrated 300-question public set, with Gemini 4 Carbon leading at a Net Score of 54

On October 31, independent evaluator Artificial Analysis released AA-Omniscience v1.1, its knowledge and hallucination benchmark and part of Intelligence Index v5. The question set shrinks from 6,000 to 3,000, dropping previously public and saturated questions, fixing errors and ambiguities, and adding new ones, and a new 300-question public set on Hugging Face is calibrated to the private set's difficulty, with 0.99 Pearson and Spearman correlation on Net Score. Gemini 4 Carbon (high) leads with a Net Score of 54, ahead of Claude Opus 5.5 at 48 and Claude Fable 5.1 at 46; Fable 5.1 has the highest accuracy (68%) and Gemini 4 Argon the lowest hallucination rate (4%). Models score about 1.9 points lower than on v1 on average, and MiniMax M3.1 Flash drops 22 points. All figures are as reported by Artificial Analysis.

Artificial Analysis releases AA-Omniscience v1.1: 3,000 refreshed questions and a calibrated 300-question public set, with Gemini 4 Carbon leading at a Net Score of 54

Key Takeaways

  • The question set shrinks from 6,000 to 3,000 across 6 domains and 42 topics: 600 each for science/engineering/math and software engineering, 450 each for finance, health, humanities/social sciences and law
  • A new 300-question public set is on Hugging Face, with 0.99 correlation to private-set Net Score and a median difference of 0.0 points
  • Net Score ranking: Gemini 4 Carbon (high) 54, Claude Opus 5.5 48, Claude Fable 5.1 46; the best open-weights model, Muse Spark Open, trails Gemini 4 Carbon by 28 points
  • Claude Fable 5.1 has the highest accuracy (68%), followed by Claude Opus 5.5 (66%); Gemini 4 Argon has the lowest hallucination rate (4%)
  • Rank order keeps a 0.98 Spearman correlation with v1, but scores are 1.9 points lower on average; MiniMax M3.1 Flash falls from 16 to -6 and MiMo V2.6 Pro from 8 to -5 (vendor-reported)
Read full story
ADSponsored

SenseTime open-sources SenseNova-Loop-9B-Preview, a 9B looped Transformer with about 14.6B inference parameters for long-context and agentic work

On Oct 30, SenseTime released SenseNova-Loop-9B-Preview (Apache 2.0) on its official X account and Hugging Face. It runs layers 4 to 27 of a 32-layer decoder twice with the same weights, so each forward pass executes 56 layer computations while storing about 9B parameters, about 14.6B at inference, and it uses two-stream mHC (manifold-constrained hyper-connections) to manage the residual streams. It takes text and images, with training sequences up to 262,144 tokens. SenseTime charts show it beating Qwen3.5 and Qwen3.6 peers on BIRD-Dev, WorkBuddy Bench, and other agent and data tasks, while it still trails on Terminal Bench 2.1; the technical report is not out yet. The official launch post drew about 910 likes.

SenseTime open-sources SenseNova-Loop-9B-Preview, a 9B looped Transformer with about 14.6B inference parameters for long-context and agentic work

Key Takeaways

  • Structure: 32 distinct decoder layers, with layers 4 to 27 looped twice on shared weights for 56 layer computations per forward pass; about 9B stored and about 14.6B inference parameters (model card)
  • Vendor-reported scores: BIRD-Dev 71.38 (Qwen3.5-27B 69.84), WorkBuddy Bench 66.89 (Qwen3.6-35B-A3B 61.98), AutomationBench 13.72 (Qwen3.5-27B 10.17)
  • Weak spots from the same vendor chart: Terminal Bench 2.1 at 40.45, below Qwen3.6-27B at 47.19; tau3-Banking at 18.56, slightly below Qwen3.5-27B at 19.59
  • Training context up to 262,144 tokens; hybrid attention uses three linear-attention layers plus one full-attention layer per four-layer group; MTP speedup is available, DSpark and DFlash2 are still training
  • Apache 2.0, requires trust_remote_code=True; official examples cover Transformers 5.18.0, a 4-GPU LightLLM setup, and an SGLang PR, and the technical report is still to come
Read full story
Linked Models & Agents:
⚡ SenseNova-Loop-9B-Preview⚡ Qwen3.5-27B⚡ Qwen3.6-35B-A3B🌐 SenseTime

Benji Taylor, head of design at X and SpaceXSI, open-sources Stageshow, an agent skill for realistic faux product UI and animated demos

On Oct 31, Benji Taylor, head of design at X and SpaceXSI, released Stageshow on X: an open-source skill (MIT license) for coding agents that helps them produce faux product UI that looks real, including stills, cursor demo animations, and bento grids, delivered as ordinary React components. It installs with one command, and he says it works with Grok Build, Claude Code, Codex, Gemini, and others. The launch post drew about 4,500 likes and 6,500 bookmarks. He notes it rarely nails a demo in one shot and most still take a few rounds of feedback.

Benji Taylor, head of design at X and SpaceXSI, open-sources Stageshow, an agent skill for realistic faux product UI and animated demos

Key Takeaways

  • Install: npx skills add benjitaylor/skills --skill stageshow; the author says it works with Grok Build, Claude Code, Codex, Gemini, and other agents (author's post)
  • Contents: a seven-step workflow in SKILL.md, reference rule docs, dozens of gold examples, a React kit, and self-check scripts such as film.mjs (GitHub)
  • License: the stageshow folder is MIT licensed; the repo was created Oct 26 and had about 61 stars at writing time
  • Reach: the launch post had about 4,521 likes, 6,561 bookmarks, and 213k views as of Nov 1, 08:00 SGT
  • Quality claims are the author's own: the same prompts did better with the skill, but no quantitative evaluation was published
Read full story

Nous Research opens the official Hermes Agent mobile beta: iOS via TestFlight, Android via Firebase, connecting your phone to your own gateway to approve tools and manage bots and routines

During NousCon 2026 in New York on Oct 30, Nous Research released an official mobile beta of Hermes Agent and put up a sign-up page at hermes-agent.nousresearch.com/mobile: iOS users join the "Hermes Agent - Mobile" beta through TestFlight, and Android users join through Firebase App Distribution. The TestFlight page says the app connects to your own Hermes gateway so you can chat with streaming, approve tool calls, and manage bots and routines from anywhere. Teknium, co-founder and lead engineer of Hermes Agent, confirmed on X that the iPhone and Android betas launched together. Nous has not announced a general release date or any benchmarks.

Key Takeaways

  • Entry point: the official page hermes-agent.nousresearch.com/mobile covers 2 platforms, iOS through TestFlight and Android through Firebase App Distribution
  • Positioning: the TestFlight description says the app connects to your own gateway for streaming chat, tool-call approval, and managing bots and routines; it is a client, not a separate agent running on the phone
  • Confirmation: Teknium, co-founder and lead engineer of Hermes Agent, confirmed in a reply on X that the iPhone and Android betas both launched on NousCon day
  • Watch for clones: several third-party Hermes phone clients already exist, so only use the links on the official page; Nous has not published a general release date or benchmarks
Read full story
A
Anthropic (Claude Help Center)support.claude.com·
👀8
🔥82

Anthropic extends Claude text watermarking to older models including Mythos 5, Opus 4.7/4.6 and Sonnet 4.6, reportedly from November 3

Anthropics help center article "How Claude marks AI-generated content" (updated Oct 28) now lists older models released before Aug 2, 2026, including Claude Mythos 5, Opus 4.7, Opus 4.6, Opus 4.5, Sonnet 4.6 and Sonnet 4.5, as carrying text watermarks on first-party surfaces, and says Anthropic is adding watermarks to these models to meet EU AI Act Article 50 transparency duties. According to a customer email screenshot reported by outlets such as MACCUS, the legacy rollout starts Nov 3, with Amazon Bedrock possibly a few days later; Anthropics public pages do not state that date. The watermark follows Google DeepMinds SynthID-Text approach, adds no hidden characters or extra tokens, and detection is in private preview only for regulators, media, researchers and similarly obligated organizations, which has drawn complaints on X that users cannot check their own text.

Anthropic extends Claude text watermarking to older models including Mythos 5, Opus 4.7/4.6 and Sonnet 4.6, reportedly from November 3

Key Takeaways

  • Scope: in the official support table, older models such as Mythos 5, Opus 4.7/4.6/4.5 and Sonnet 4.6/4.5 are ticked only for first-party text watermarks; cloud-partner watermarks and C2PA file credentials remain limited to models launched after Aug 2 (see the help center)
  • Timing: a customer email reported by media puts the start at Nov 3, with Bedrock possibly a few days later (MACCUS); Anthropics public pages give no date
  • Cost and quality: Anthropic says the watermark adds no characters, no extra tokens and no extra cost, using a variant of SynthID-Text (see Anthropics explainer)
  • Detection: the detection API is in private preview for regulators, law enforcement, media, fact-checkers, researchers and obligated enterprises; ordinary users cannot check text yet
  • Reach: watermarks apply worldwide across Claude, the Claude Platform API, Claude Code, Cowork and Tag, because Anthropic says it has no durable way to scope them by region yet
Read full story

Microsoft Research and UC Berkeley open-source TokenEconomizer, a plugin that cuts Claude Code and Codex costs by 18.4–30.9% on SWE-Bench without changing the agent

Microsoft Research, Microsoft Security and UC Berkeley open-sourced TokenEconomizer on GitHub (Apache 2.0, v0.1.0 released October 26), a plugin for Claude Code, Codex, GitHub Copilot CLI and Pi, with experimental opencode support. It learns from earlier sessions in the same repository: micro-skills remember repo facts, tool pruning drops tool definitions that go unused, and a loop guard nudges an agent that is stuck. The paper reports 18.4–30.9% lower mean cost across five agent and model combinations on 277 SWE-Bench tasks (paper figures).

Microsoft Research and UC Berkeley open-source TokenEconomizer, a plugin that cuts Claude Code and Codex costs by 18.4–30.9% on SWE-Bench without changing the agent

Key Takeaways

  • Cost: on 277 SWE-Bench tasks across 6 repositories and 5 agent and model combinations, mean cost fell 18.4–30.9%, and all 30 repository-by-combination cells got cheaper (paper figures, including the plugin's own model calls)
  • Success rate: Pass@1 rose in 4 of 5 combinations, e.g. Copilot CLI with Sonnet 5 cost 18.4% less with Pass@1 +2.6, while Claude Code with Opus 4.8 cost 30.9% less with Pass@1 -1.0
  • Three mechanisms: micro-skills (repo facts stated only after three sessions confirm them), tool pruning (by default a tool unused over 10 prompts across 2 sessions is left out), and a failure-loop guard (one redirect when a judge is at least 0.7 confident, never stopping a turn itself)
  • Generalization: 16–21% lower cost on Web-Bench and 6–20% lower on two security-auditing benchmarks where every task is a new repository
  • Deployment: Apache 2.0, Python 3.10+, no API key of its own, and learned experience stays local in ~/.tokeneconomizer
Read full story

Vercel Labs launches agent-desktop: computer use for any coding agent via OS accessibility trees, not pixels, on macOS, Windows and Linux

On October 31, Chris Tate of Vercel Labs, creator of agent-browser, announced agent-desktop on X as "agent-browser, for your whole computer". It is an Apache-2.0 Rust CLI and C library that reads a desktop app's OS accessibility tree and returns every actionable element as a JSON ref; the agent clicks or types on a ref and snapshots again to verify, with no pixel matching, headless by default. Version 1.0.0 shipped on October 27 and added Linux support; the current npm release is 1.0.2.

Vercel Labs launches agent-desktop: computer use for any coding agent via OS accessibility trees, not pixels, on macOS, Windows and Linux

Key Takeaways

  • Install: npm install -g agent-desktop, one package with native x64/ARM64 binaries; 1.0.0 (Oct 27) added Linux (glibc 2.35+, via AT-SPI), and the latest npm release is 1.0.2 (Oct 30)
  • Loop: snapshot prints a JSON tree with refs, click @<snapshot_id>:eN acts, then snapshot again to verify; a changed UI returns STALE_REF, and errors say whether a retry is safe
  • Scope: the README lists 60 command names, 56 of them operational, spanning windows, keyboard and mouse, notifications, clipboard, waits and session traces
  • Headless by default: ref actions go through accessibility APIs without moving the pointer or stealing focus, with --headed for physical input; Chris Tate says multiple agents can use the computer in parallel, each with its own cursor
  • Benchmarks: no official success-rate or speed numbers; it is a tool with no model inside, and web pages stay with agent-browser
Read full story
ADSponsored

Pika releases open-weight video model Pika H3 Flex: post-trained on MiniMax H3, six-step sampling, five audio stems, API from $0.01 per second

On October 29 Pika released Pika H3 Flex, a joint audio-video generator post-trained on MiniMax H3, with weights on Hugging Face, code on GitHub, and ComfyUI and Diffusers support. Pika says it distilled sampling from 50 denoising steps to six, averages about 1.8x faster DiT denoising than Fal H3 Max at 768p, and can produce a 15-second clip with soundtrack in as little as about 7 seconds; the hosted API adds 1080p to 4K upscaling and five exportable audio stems (dialogue, score, SFX, foley, ambience). All speed and quality figures are vendor-reported.

Pika releases open-weight video model Pika H3 Flex: post-trained on MiniMax H3, six-step sampling, five audio stems, API from $0.01 per second

Key Takeaways

  • Pricing (vendor figures): text/image-to-video from $0.01 per output second, reference-to-video from $0.03/s; Pika's comparison table lists MiniMax H3 at $0.08/s and Seedance 2.5 at $0.103/s
  • Speed (vendor figures): six-step sampling, about 1.8x faster DiT denoising than Fal H3 Max at 768p on average and about 2x for 10–15 s text/image-to-video; 1.60x faster end-to-end 5 s 768p generation on eight B300 GPUs
  • Ranking: Pika's product page says it scores 1293 and ranks #7 on DesignArena's text-to-video board, the highest open-weight model there
  • Release form: the Hugging Face repo is tagged as an adapter on MiniMax-H3 under an 'other' license; local inference natively supports 480p/768p with mixed stereo audio, while 4K upscaling and audio stems are hosted-API only
  • Accepts up to 12 reference inputs (image, audio, video, sketch and more) and supports style transfer, motion transfer, character swap and targeted edits
Read full story
Linked Models & Agents:
⚡ Pika H3 Flex⚡ MiniMax H3⚡ Fal H3 Max⚡ HeyGen Video⚡ Gemini Omni 1.1 Flash🌐 Pika🌐 MiniMax

Apple Intelligence is coming to China: iOS 27.3 developer beta starts Nov 4, public release in December, with Alibaba Qwen inside Siri, Writing Tools and Visual Intelligence

In a press release on its China newsroom, Apple said the first Apple Intelligence features will open for testing in the latest iOS developer beta starting November 4 and reach users in China with the iOS 27.3 release in December. The features run on Apple-built generative models and include Live Translation, Writing Tools, Visual Intelligence, Clean Up, Genmoji, notification and Mail summaries, and Type to Siri; Apple also partnered with Alibaba to bring Qwen into Siri, Writing Tools and Visual Intelligence. The first wave covers iPhone 15 Pro and newer only; Siri AI and the other next-generation features announced at WWDC 2026, plus Image Playground, are not included, and Mac, iPad and other platforms wait on further approvals.

Apple Intelligence is coming to China: iOS 27.3 developer beta starts Nov 4, public release in December, with Alibaba Qwen inside Siri, Writing Tools and Visual Intelligence

Key Takeaways

  • Timeline (Apple): testing in the latest iOS developer beta from November 4, public rollout with iOS 27.3 in December, no exact date given
  • First-wave features include Live Translation (Messages, FaceTime, Phone and AirPods), Writing Tools, Visual Intelligence, Clean Up, Genmoji, natural-language photo search, Priority Mail, notification summaries and Type to Siri
  • Alibaba Qwen is built into Siri, Writing Tools and Visual Intelligence: users can ask about photos, PDFs and presentations and use Qwen to compose original text, signing in with a Qwen account or Sign in with Apple
  • Supported devices: iPhone 16 and later, iPhone Duo, iPhone 15 Pro/Pro Max and iPhone Air, with Siri and device language set to English and Simplified Chinese
  • Siri AI and other next-generation WWDC 2026 features are excluded, MacRumors says Image Playground is also missing, and other platforms follow after the necessary approvals
Read full story
Linked Models & Agents:
⚡ Qwen⚡ Apple Foundation Models🤖 Siri🌐 Apple🌐 Alibaba

OpenAI rolls out GPT-6 Rosalind Research, a GPT-6 generation life sciences model for approved research orgs in Work, Codex and the API at $15/$75 per million tokens

In its October 30 ChatGPT Business release notes, OpenAI said GPT-6 Rosalind Research is rolling out to a limited set of customers with Research approval. It shows up in the model picker in ChatGPT Work and Codex, not in the Chat tab, and separately approved organizations can call it through the API as gpt-6-rosalind. OpenAI's token-based Enterprise rate card lists it at $15 per million input tokens, $1.50 cached input and $75 output, three times the price of GPT-5.5 Rosalind Research.

Key Takeaways

  • Approved orgs only: both the organization and the user need Rosalind Research approval, and Discovery approval does not include it
  • Where to use it: the model picker in ChatGPT Work and Codex, not the Chat tab; in Codex it pairs with the Life Sciences Research plugin
  • API model name gpt-6-rosalind needs separate approval and is limited to internal research tools, not customer-facing products
  • Priced at $15 input, $1.50 cached input and $75 output per million tokens, versus $5/$0.50/$25 for GPT-5.5 Rosalind Research
  • Enterprise workspaces start with a two-week Admin Preview that is off by default until an admin enables it for approved users
Read full story
Linked Models & Agents:
⚡ GPT-6 Rosalind Research⚡ GPT-5.5 Rosalind Research⚡ GPT-6 Astra🤖 Codex🤖 ChatGPT Work🌐 OpenAI

micro1 releases Dual-Arm Sim, an operating-room robot benchmark: 10 frontier models finished only 11 of 800 trials, and all 213 "task complete" claims were false

AI data company micro1 released Dual-Arm Sim, which has 10 general-purpose frontier models control a two-arm Franka Panda robot in a simulated operating room built on NVIDIA Isaac Sim, using only camera images and robot sensors, across four tasks: swapping instruments, replacing a faulty drug cartridge, passing a sample between hands, and packing a surgical kit. Only 11 of 800 trials were completed, all by Gemini 4 Argon (9) and GPT-6 Astra (2). Models claimed "task complete" in 213 trials and were wrong every time. All 200 traces of the cartridge-swap task are public on Hugging Face.

micro1 releases Dual-Arm Sim, an operating-room robot benchmark: 10 frontier models finished only 11 of 800 trials, and all 213 "task complete" claims were false

Key Takeaways

  • Only 11 of 800 trials finished: Gemini 4 Argon 9 (6/20 cartridge swaps plus 3 surgical kits) and GPT-6 Astra 2; no model completed the instrument swap or the two-arm sample transfer (per micro1)
  • All 213 "task complete" claims were false, and in 94 of them the robot never touched the object; Gemini 3.1 Pro made the claim in 49 of 80 trials
  • Thinking longer did not help: Argon used only 315 tokens per decision and still led; its 9 successes cost $119 in total, while Claude Fable 5.1 spent $839 for none
  • Recovery decided success: Argon and Astra regained a real grasp after a miss in about two-thirds of trials, Grok 4.7 in 3 of 80; first position estimates were a median 33 cm off
  • Lifted faulty cartridges ended on the floor 14 times and on the trolley 11 times, versus only 8 correct swaps
Read full story

Claude API launches the Usage and Cost Analytics API in beta and raises the request size limit to 128 MB

Per the official Claude API release notes, on Oct 29 Anthropic launched the Usage and Cost Analytics API in beta, with two endpoints, /v1/organizations/analytics/usage and /analytics/cost, that filter and group token usage and cost by model, workspace, API key, and the user or service account behind each request, with 1-minute, 1-hour, or 1-day buckets. The older Usage and Cost API is now legacy but still supported. On Oct 28 the maximum request size for the Messages and Token Counting APIs on the first-party Claude API rose from 32 MB to 128 MB.

Key Takeaways

  • The new API needs the analytics-usage-cost-2026-08-24 beta header; one endpoint returns token and request counts, the other cost in USD (per the official docs)
  • group_by takes up to 5 dimensions, time buckets can be 1m, 1h, or 1d, and each filter accepts up to 100 values
  • Claude Console and Claude Enterprise organizations share the same endpoints and fields; it also works on Claude Platform on AWS and Claude Models on Google Cloud (Anthropic managed)
  • The old Usage and Cost API and four Enterprise Analytics usage and cost report endpoints are now legacy but still supported, with migration guides
  • Since Oct 28 the Messages and Token Counting APIs accept requests up to 128 MB instead of 32 MB (4x), on the first-party Claude API only
Read full story