AI Coding Live News

Artificial Analysis Makes Time per Task Its Headline Performance Metric: GPT-6 Astra Finishes a Max-Effort Task in About 17 Minutes, Ahead of Opus 5.5 and Gemini 4 Carbon

Independent benchmarker Artificial Analysis announced on X on November 4 (17:34 UTC) a new version of its API performance benchmarking: the headline metric moves from output speed to Time per Task, the time to finish one Intelligence Index task (output tokens per task divided by end-to-end output speed). It covers about 1,000 serverless endpoints, measures speed from sending the request to the final token, and adds multi-turn agentic coding and knowledge-work workloads. Per its data, GPT-6 Astra at max effort runs at 51 tokens/s yet finishes a task in about 17 minutes, against about 26 for Claude Opus 5.5 (max) and about 29 for Gemini 4 Carbon (high).

Key Takeaways

  • Time per Task equals output tokens per Intelligence Index task divided by end-to-end output speed, so a model that is fast per token but verbose can finish later than a slower model that uses fewer tokens.
  • End-to-end output speed runs from sending the request to the final token, including the wait before the first token (prefill and hidden reasoning); output tokens now come from each provider's API-reported counts instead of the o200k_base tokenizer.
  • GPT-6 Astra (max) runs at 51 tokens/s with about 50k output tokens per task and takes about 17 minutes; Claude Opus 5.5 (max, 111 tokens/s) takes about 26 minutes and Gemini 4 Carbon (high, 71 tokens/s) about 29, using roughly 120k to 170k tokens per task.
  • At each lab's API default effort (medium for all three), GPT-6 Astra, GPT-6.1 Sol and Opus 5.5 cut Time per Task by about 3 to 5x and Cost per Task by about 2 to 4x, scoring about 5 to 11 points lower; Opus 5.5 drops from about 26 minutes and $10.04 to about 6.8 minutes and $2.45.
  • The official methodology page lists this as version 3.0.0 (October 30), with runs now every 6 hours and a new endpoint error rate metric.
Read full story

RoboColosseum Opens Real-Robot Evaluation: 100+ Robots at 124 Sites, Claude Opus 5.5 and GPT-6 Astra Rival Specialized VLA Policies Zero-Shot

Hugging Face, BitRobot, the Singapore Embodied AI Centre, NUS and others launched RoboColosseum on November 4, a distributed real-robot evaluation framework covering four embodiments: SO-101, Franka, Bimanual-YAM and the Unitree G1 humanoid. The first study ran 5,699 blinded pairwise comparisons at 124 sites across 5 VLA policies and 3 frontier models. Claude Opus 5.5 and GPT-6 Astra beat their VLA counterparts on average task progress by 12.1 and 11.0 points, while Grok 4.7 trailed by 7.5. All rollouts are open on Hugging Face, and the project pledges 10,000 free evaluation hours to academic labs.

RoboColosseum Opens Real-Robot Evaluation: 100+ Robots at 124 Sites, Claude Opus 5.5 and GPT-6 Astra Rival Specialized VLA Policies Zero-Shot

Key Takeaways

  • Two tracks: the Open Track runs blinded zero-shot pairwise comparisons, and the Fine-tune Track gives each VLA the same 100 demonstrations per task across 20 tasks.
  • The VLAs tested are GR00T N1.7, pi0.5, MolmoAct2, G0.5 and LingBot-VLA v2; the frontier models are GPT-6 Astra, Claude Opus 5.5 and Grok 4.7.
  • After fine-tuning, GR00T N1.7 leads on SO-101 and pi0.5 leads on Franka and Bimanual-YAM; on the G1 humanoid no policy completes any task, with average progress of 13.3% to 23.2%.
  • Rankings agree only weakly across robots (Kendall W = 0.24), and zero-shot rankings poorly predict rankings after fine-tuning.
Read full story

CellType Launches BioSimBench: Frontier LLMs Get Only Part of Cell Responses Right, Gemini 4 Argon Leads and CellType 27B Beats Them on Every Track

CellType, a YC W26 startup, released BioSimBench 1.0 on November 4. It uses real lab experiments to test whether language models can predict which genes go up or down after a cell is hit by a drug, a gene knockdown or an immune signal. Among 12 frontier models, Gemini 4 Argon ranks first with an overall score of 0.184, ahead of Claude Sonnet 5.5 (0.160) and GPT-6 Astra (0.159), while two lab replicates agree at 0.462. A 27B model CellType trained in its BioSimGym RL environments beats the best frontier model on all four prediction tracks.

CellType Launches BioSimBench: Frontier LLMs Get Only Part of Cell Responses Right, Gemini 4 Argon Leads and CellType 27B Beats Them on Every Track

Key Takeaways

  • BioSimBench 1.0 has five tracks: new drugs and cell contexts, gene knockdown, drug response, immune signals, and a tool-using research agent; test answers are kept private.
  • The 12 frontier models score between 0.110 and 0.184 overall, with Gemini 4 Argon first and DeepSeek V4 Pro last; two lab replicates agree at 0.462, so the gap is still large.
  • CellType 27B scores 0.366 on new drugs and cell contexts and 0.203 on drug response, about double the best frontier score of 0.103.
  • Data processing uses NVIDIA RAPIDS-singlecell, at least 4x faster for the whole pipeline; models were trained with NeMo RL and BioSimGym follows NeMo RL environment interfaces.
Read full story

LiberAI Unveils Liber-0 World Action Model: Pretrained on 2.2M Hours of Human Experience, 36% Zero-Shot Success Across 60 Manipulation Tasks

Robotics company LiberAI announced Liber-0 on its official X account and technical blog. It is a World Action Model that jointly predicts future frames and actions, pretrained on more than 2.2 million hours of human experience and anchored by precise hand-motion data from its own LiberSense Glove. On 60 tasks proposed by GPT-6 across 600 trials, Liber-0 reached 36.0% overall success without robot demonstrations collected for those tasks, but only 10.5% on challenging multi-step tasks. No open weights or API have been announced.

LiberAI Unveils Liber-0 World Action Model: Pretrained on 2.2M Hours of Human Experience, 36% Zero-Shot Success Across 60 Manipulation Tasks

Key Takeaways

  • Zero-shot results: 63.5% on pick-and-place, 34.0% on short non-pick-and-place tasks and 10.5% on challenging multi-step tasks, 36.0% overall (60 tasks x 10 trials)
  • For comparison, GPT-6 Astra used alone as a robot policy scored 8.3%, 5.0% and 1.7% on the same three task groups, with 87.3 s of reasoning per decision
  • 10K hours of glove data beat 200 times more web human video (2,000K hours), suggesting precise action labels matter more than raw video volume
  • Glove data plus 25% of the robot demonstrations reached a progress score of 75.6, above the 72.8 from robot-only training with the full pool, using 75% fewer robot demos
  • All figures are LiberAI self-reported internal evaluations; no open weights, API or commercial timeline has been announced
Read full story
Linked Models & Agents:
ADSponsored

Artificial Analysis Upgrades Its Six Capability Indexes to v2.0, Weighting Non-Hallucination and Agentic Tool Use; Claude Opus 5.5 Leads All Six

Independent evaluator Artificial Analysis announced on X on November 4 that its six Capability Indexes (Finance & Accounting, Strategy & Ops, Legal, Healthcare & Medical, Engineering, Economics) are now v2.0, aligned with Intelligence Index v5.0 evaluations and weighting Non-Hallucination and Agentic Tool Use more heavily. Across the indexes, HLE becomes HLE-Diamond, AA-Omniscience moves to v1.1 and GDPval-AA is removed; Engineering gains a new Science capability. Per Artificial Analysis, Claude Opus 5.5 (max) leads all six, with GPT-6 Astra (max) second in Finance & Accounting, Legal and Engineering. Among open-weights models, Kimi K3.1 Pro (weights not yet released) leads all six at #5 to #8.

Artificial Analysis Upgrades Its Six Capability Indexes to v2.0, Weighting Non-Hallucination and Agentic Tool Use; Claude Opus 5.5 Leads All Six

Key Takeaways

  • The six indexes map O*NET occupation tasks to representative benchmarks, weighted by how often each capability appears in that occupation (methodology page)
  • Common changes: HLE becomes HLE-Diamond, AA-Omniscience moves to v1.1, and GDPval-AA is dropped from Agentic Knowledge Work (now AA-Briefcase v1.1)
  • Non-Hallucination weight rises to 15% in Finance & Accounting and Legal; Agentic Tool Use (AutomationBench-AA) is 35% of Strategy & Ops, its largest component
  • Engineering adds Science (20%, CritPt v2 Hard Subset plus Terminal-Bench-Science 0.1) and FrontierCode 2.0 under Agentic Coding; Economics swaps AA-LCR for GDP.pdf
  • Results per Artificial Analysis: Claude Opus 5.5 (max) is #1 in all six; among open weights, Kimi K3.1 Pro leads all six, MiniMax-M3.1-Flash leads Strategy & Ops (#10) and DeepSeek V4.1 Flash 1017 (max) leads Healthcare & Medical (#12)
Read full story

OpenAI Shares Progress on ChatGPT and Codex for Hardware Engineering: GPT-6 Astra Designs a Codex Device in Under a Week, Mazda Joins for Aerodynamics Research

On November 3, OpenAI published "Accelerating engineering for the physical world," describing how its models help with mechanical design, electrical design and simulation. Two employees used GPT-6 Astra to design a device for talking to Codex (enclosure, PCB, firmware and software) in under a week, and a contract manufacturer built a small prototype batch in under a month, though manufacturing readiness still took several rounds of human review. Token usage across OpenAI hardware teams has grown 23-fold since February. On BenchCAD 2.0, a newer internal model averaged 0.875 versus 0.594 for GPT-6 Astra at its highest reasoning setting (OpenAI-reported). OpenAI is also expanding its work with Chip Ganassi Racing and announced a new research collaboration with Mazda.

OpenAI Shares Progress on ChatGPT and Codex for Hardware Engineering: GPT-6 Astra Designs a Codex Device in Under a Week, Mazda Joins for Aerodynamics Research

Key Takeaways

  • In a test with no direct human edits, GPT-6 Astra handled the look, enclosure structure, component selection, PCB layout, UI and firmware; two employees finished the design in under a week as a side project, and prototypes came back in under a month, per the OpenAI blog.
  • OpenAI names the gaps: Astra did not consistently account for the manufacturer's production limits, tolerances or assembly details, so manufacturing readiness took several rounds of review.
  • OpenAI hardware and infrastructure teams use Codex and ChatGPT for CAD models, 2D manufacturing drawings, simulation and FEA setup, and design reviews; token usage has grown 23-fold since February (OpenAI-reported).
  • BenchCAD 2.0 (reconstructing 3D parts and assemblies, identifying circuit-board connections): a newer internal model scored 0.875 versus 0.594 for GPT-6 Astra at its highest reasoning setting (OpenAI-reported; the internal model is unnamed and unreleased).
  • Collaborators: Chip Ganassi Racing is testing 3D-scan-to-editable-CAD and 2D drawing workflows; Mazda is working with OpenAI researchers on airflow and structural simulations for vehicle design, with results promised "in the coming months."
Read full story

Flower Labs Releases Endeavor 1.1: Multimodal, EU-Only Inference and Private Deployment With Readable Thinking Traces, Claims Parity With OpenAI and Anthropic

Flower Labs, the company behind the Flower federated learning framework, released Endeavor 1.1 on November 3, its third model this year after the UK sovereign 7B model Lizzy in April and Endeavor 1.0 in September. The update adds image input, an optional EU-only GPU inference tier, and Flower-managed, private-cloud or on-premises deployment, and promises readable thinking traces plus ownership of outputs that customers may use to train their own models. Vendor-reported scores are GPQA 94.4, HumanEval 99.9, AIME 2026 99.9 and MMMU-Pro 81.1, but the comparison uses GPT-5.6 Sol and Claude Fable 5 rather than either lab's newest models, and access is request-only for now.

Flower Labs Releases Endeavor 1.1: Multimodal, EU-Only Inference and Private Deployment With Readable Thinking Traces, Claims Parity With OpenAI and Anthropic

Key Takeaways

  • Vendor-reported: GPQA rose from 92.0 in 1.0 to 94.4 (about 30% fewer errors), HumanEval from 98.2 to 99.9; IFEval is 94.5 and MMMU-Pro 81.1.
  • In the vendor table, GPT-5.6 Sol scores GPQA 94.1, IFEval 95.9 and MMMU-Pro 83.0, and Claude Fable 5 scores GPQA 92.6; Endeavor does not lead on IFEval or MMMU-Pro.
  • New EU-only GPU inference with SLAs, with UK, Middle East, Asia and Africa regions planned.
  • The pitch is control: raw thinking traces, ownership of outputs and traces, and the right to fine-tune or train your own models on them.
  • Flower says the model builds on mature open-weight models via continual pre-training, targeted post-training and model integration, without naming the base or parameter count; access is request-only.
Read full story
Linked Models & Agents:
⚡ Endeavor 1.1⚡ Endeavor 1.0⚡ GPT-5.6 Sol⚡ Claude Fable 5⚡ Kimi K3⚡ Nemotron 3 Ultra🌐 Flower Labs

X Discussion: MIT Team Says GPT-6 Astra Can Read and Write Neural Network Weights, Editing 0.016% of Qwen3.5-0.8B to Lift MATH-500 From 7.9% to 48.1%

On November 2, MIT CSAIL PhD student Rikiya Takehi posted "Weight-Space Programming" on X: a team (Takehi, Jayden Teoh, Alex Zhang, Omar Khattab) had GPT-6 Astra read and edit neural network weights directly, with no gradients or training. Their blog says Astra changed only 131,072 weights (0.016%) of Qwen3.5-0.8B, fixed its thinking loops and raised MATH-500 from 7.9% to 48.1%. The post drew about 24K likes and 1.77M views, and Ethan Mollick quoted it saying it is a big deal pending replication. All results are self-reported by the authors and not yet independently reproduced.

X Discussion: MIT Team Says GPT-6 Astra Can Read and Write Neural Network Weights, Editing 0.016% of Qwen3.5-0.8B to Lift MATH-500 From 7.9% to 48.1%

Key Takeaways

  • The original post (2026-11-02 17:51 UTC) had about 24,320 likes, 2,697 reposts, 2,284 quotes, 1.77M views and 15K bookmarks at fetch time; Wharton professor Ethan Mollick quoted it saying it is a pretty big deal pending replication (about 880 likes).
  • Experiment 8 (authors' figures): with a 50 forward-pass budget, Astra edited 131,072 weights (0.016%) of Qwen3.5-0.8B, raising MATH-500 from 7.9% to 48.1% and IFEval from 21.0% to 62.3%, while answers hitting the token limit fell from 93.0% to 33.1%.
  • Experiment 5 (authors' figures): with no data, gradients or tools, Astra wrote MinAtar policy networks in one shot that scored 517.4 on Breakout versus 15.8 for PPO at 100M steps and 25.3 at 500M steps; on Seaquest it scored 53.1, below the 88.9 of 500M-step PPO.
  • Limits the authors report: on Gemma 3 270M, which rarely loops, Astra's edits moved MATH-500 by no more than about a point; they conclude weight edits can remove an obstacle hiding an ability but cannot add one the model lacks.
  • Full experiment logs are public at RikiyaT/lm_understand-logs; so far there is only a blog post, with no peer-reviewed paper and no third-party replication.
Read full story
Linked Models & Agents:

Deep Principle Open-Sources Hydrogen-1.0, a 753B Science Model Post-Trained From GLM-5.3 on Lab Records, MIT Licensed

Hangzhou-based AI-for-science company Deep Principle released Hydrogen-1.0 on November 2, its first general-purpose scientific model. It post-trains Zhipu's GLM-5.3 with SFT and RL on chemistry, materials and life-science data plus its own lab records and discovery trajectories, and ships about 753B parameters of BF16 weights on Hugging Face under the MIT license. By the vendor's own evaluation it scores 38.3% on FrontierScience-Research versus 33.3% for GPT-6 Astra; none of the results have been independently reproduced yet.

Deep Principle Open-Sources Hydrogen-1.0, a 753B Science Model Post-Trained From GLM-5.3 on Lab Records, MIT Licensed

Key Takeaways

  • Scale: Hugging Face lists about 753B total parameters (BF16, roughly 1.5 TB of weights), glm_moe_dsa architecture, 1M-token context and 128K max output, MIT licensed (download requires accepting HF terms).
  • Benchmarks (vendor-reported): 38.3% on FrontierScience-Research vs 33.3% for GPT-6 Astra; 93.0% on GPQA Diamond, which the company says roughly matches Kimi K3.
  • Internal scenarios (vendor-reported): leads max-thinking GPT-6 Astra by 5.13 points on scientific computing and 4.76 points on forward reaction prediction, but trails it by 3.33 points on NMR structure elucidation.
  • Materials discovery: after five rounds of transition-metal-complex search, the mean best HOMO-LUMO gap reached 4.318 eV vs 3.689 eV for GPT-6 Astra and 3.353 eV for Kimi K3 (official blog).
  • Access: weights on HF and ModelScope, plus NVFP4 (B200/B300) and MXFP4 (MI350X/MI355X) quantized repos; API via NeuroSpark and in-app use in the Mira AI Scientist; tested with SGLang on 8 GPUs.
Read full story

Altman at ADIPEC: The Internal Model Behind the 10,000-Agent Navier-Stokes Proof Is "the Next GPT," Coming Soon

Speaking at the ADIPEC energy conference in Abu Dhabi on November 2, OpenAI CEO Sam Altman said the September run in which 10,000 agents collaborated for about four days used "the model that is going to be released soon, the next GPT," stressing that the agents had no hierarchy and were fully decentralized. It is the first public statement tying the internal model behind OpenAI's September Navier-Stokes proof to its next flagship, though OpenAI has given no name, release date or price.

Altman at ADIPEC: The Internal Model Behind the 10,000-Agent Navier-Stokes Proof Is "the Next GPT," Coming Soon

Key Takeaways

  • Quote (ADIPEC keynote video): "It was 10,000 agents of the model that is going to be released soon, the next GPT, working for about four days, nonstop."
  • OpenAI's September 8 blog post: about 10,000 concurrent agents reached the result in about 88 hours, and GPT-6 Astra took another 17 hours for Lean formalization and verification.
  • Scale (OpenAI figures): 2.7 million agent messages and about 130 billion output tokens for Navier-Stokes alone; 4.9 million messages and about 300 billion output tokens across all attempted problems.
  • The Lean proof is public at openai/NavierStokesAndEuler and establishes statements C and D of the official Clay formulation (breakdown with smooth forcing).
  • Not disclosed: the next GPT's name, release date, price or benchmarks; names like "GPT-6.2 Astra" circulating on X are speculation.
Read full story
Linked Models & Agents:
ADSponsored

OpenAI Introduces LifeVal, a Benchmark for Everyday Life Tasks Built From Time-Use Studies and a 3,995-Person Survey

On November 2 OpenAI published LifeVal, an evaluation of whether AI can actually get everyday tasks done for ordinary people, such as finding childcare, accessing government services, budgeting, ordering groceries and adapting recipes. The task list draws on the American Time Use Survey, the Multinational Time Use Study and a new demographically representative OpenAI survey of 3,995 people. OpenAI says it has used LifeVal for the past year to track and improve its models, and it lists several best recorded GPT-6 Astra task scores, many at 100%. All scores are vendor-reported and have not been independently reproduced.

OpenAI Introduces LifeVal, a Benchmark for Everyday Life Tasks Built From Time-Use Studies and a 3,995-Person Survey

Key Takeaways

  • Task sources: the American Time Use Survey, the Multinational Time Use Study and a new representative OpenAI survey of 3,995 respondents (official blog).
  • Domains covered: caregiving, health, education, household administration, personal finances, shopping and government services.
  • Example scores (vendor-reported): kindergarten enrollment after a move 93.1%, flood volunteer coordination 98.0%, home search with deed added to cart 100%, diabetes meal plan 90.4%.
  • GPT-6 Astra's best recorded score is 100% on tasks such as booking a toddler sensory class, booking a car inspection, ordering halal groceries within budget and unsubscribing from email lists.
  • The official text we read gives no full task count or overall score, so overall figures circulating on X are not used here.
Read full story

OpenAI's Tibo Says Dots Will Expand Its Model Family to Include GPT-6.1 Terra for Speed and Wider Reach

At 15:50 UTC on Nov 2, Tibo (@thsottiaux), whose X bio reads "Codex & ChatGPT @OpenAI", posted that OpenAI is working on expanding the family of frontier models that power dots, including GPT-6 Astra and GPT-6.1 Terra, with others to come. He said Terra brings speed and "a nice personality upgrade" and will help bring dots to more people. Dots are the always-on agents in ChatGPT with their own cloud computer, launched on GPT-6 Astra. This is a first-hand post by an OpenAI employee, not a formal company announcement; no timing or plan details have been published.

OpenAI's Tibo Says Dots Will Expand Its Model Family to Include GPT-6.1 Terra for Speed and Wider Reach

Key Takeaways

  • Source: an original post by Tibo (@thsottiaux, X bio "Codex & ChatGPT @OpenAI"), which drew about 2,475 likes, 622 replies and 127K views within roughly 20 minutes.
  • Key point: dots will no longer run only on GPT-6 Astra; GPT-6.1 Terra is being added, with more models later. It is described as work in progress with no launch date.
  • Terra per OpenAI: standard API pricing of $1 input and $5 output per million tokens, 50% below GPT-5.6 Terra and GPT-6.1 Sol, and over 3x faster task completion than GPT-6 Astra (OpenAI).
  • Current access: dots are rolling out to Pro users 18+ outside the EEA, Switzerland and the UK and to Business Premium; Enterprise needs an admin to enable the beta (Help Center).
Read full story

SemiAnalysis releases GDPx, an agentic benchmark of 206 tasks across 11 high-value domains where the top model, Claude Opus 5.5, scores just 12%

On Nov 2, semiconductor and AI research firm SemiAnalysis released GDPx, a benchmark of agentic capability across 11 domains: chip design, cybersecurity, biology, finance, legal, quant trading, recursive self-improvement (RSI), hardware design, materials science, alignment and software engineering. Its 206 tasks were built by 14 specialist data partners, with SemiAnalysis doing final QA. On the official leaderboard Claude Opus 5.5 leads at 12.0%, followed by Gemini 4 Carbon at 10.9% and GPT-6 Astra at 9.6%; nearly every model scores 0 on finance and legal. SemiAnalysis says safety classifiers drag down Opus 5.5 and GPT-6 Astra, and plans a new version every 3–6 months. All scores are as reported by SemiAnalysis.

SemiAnalysis releases GDPx, an agentic benchmark of 206 tasks across 11 high-value domains where the top model, Claude Opus 5.5, scores just 12%

Key Takeaways

  • Scale: 11 domains, 14 data partners and 206 tasks, with a default time limit of 8 hours per task (GDPx site)
  • Leaderboard (as reported by SemiAnalysis): Claude Opus 5.5 12.0%, Gemini 4 Carbon 10.9%, GPT-6 Astra 9.6%, Muse Wonder Full 9.0%, Claude Fable 5.1 8.5%, GPT 6.1 Sol 8.4%, Claude Sonnet 5.5 8.2%
  • Lower tier and open weights: DeepSeek 4.1 Flash 1017 5.4%, GPT-6 Luna 5.1%, Grok 4.7 3.9%, GLM 5.3 2.7%; almost every model scores 0 on finance and legal
  • Method: each model runs in its native harness where one exists (Claude Code for Opus, Codex for Astra, Antigravity for Carbon), otherwise OpenCode; the headline is pass@1 over three attempts with all domains weighted equally (SemiAnalysis blog)
  • By domain: Opus 5.5 wins quant trading, hardware and chip design; Gemini 4 Carbon wins biology and software engineering; GPT-6 Astra wins RSI and materials science; Muse Wonder Full is the strongest cyber model
Read full story

Parameter discloses a ChatGPT share-link flaw that let one opened link read private chats; OpenAI fixed it Oct 26 and rated it P1

Security firm Parameter published an exploit chain in which an attacker publishes a malicious conversation through ChatGPT's normal sharing feature; when a signed-in victim opens the /share/ link, the payload runs as chatgpt.com in their session, lists conversations, reads a private chat that was never shared, and sends data out. Parameter reported it through OpenAI's bug bounty on October 18; OpenAI raised it from P2 to P1, fixed it on October 26 and paid a $5,000 bounty. Parameter reports no real-world use, and users do not need to do anything.

Parameter discloses a ChatGPT share-link flaw that let one opened link read private chats; OpenAI fixed it Oct 26 and rated it P1

Key Takeaways

  • Timeline: reported Oct 18; OpenAI reproduced it Oct 21 and raised it from P2 to P1; both web frontends fixed by Oct 26; published Oct 28 (Parameter writeup)
  • Very low bar: no app install, project join or pasted code; in the auto-preview variant, opening the link was the only action, firing after about 4.5 seconds (per Parameter)
  • Three root causes: MathLive did not check the message sender, the message could carry raw HTML as keyboard-layout data, and that HTML could create an unsandboxed iframe with the chatgpt.com identity; YouTube JSONP was only the final CSP bypass
  • Bounty was $5,000; Simon Willison called it "a bit cheap" for a flaw this serious (blog)
  • MathLive 0.111.2 (Oct 31) now defaults to same-origin validation and blocks cross-window custom HTML layouts (changelog)
Read full story

X discussion: is GPT-6 Astra robotics' "GPT-3 moment"? Ex-OpenAI researcher Will Depue says specialized ML got "bitter lessoned"

Over the past day, X has been debating whether GPT-6 Astra can work directly as a robot policy. Former OpenAI researcher Will Depue (whose bio lists Sora 1 and 2 and o3/4o post-training) called Astra beating specialized robotics models "deeply surprising", then described it as "the final death of specialized ML". Investor Freda Duan posted that "Astra IS robotics' GPT-3 moment", drawing about 84K views. Third-party evaluations point both ways: in a RoboDojo paper, Astra averages 22.48% success and ranks above all 40 public policies, while an EBench report puts it at 46.7%, third of nine models. This is a discussion of opinions, not an official OpenAI conclusion.

X discussion: is GPT-6 Astra robotics' "GPT-3 moment"? Ex-OpenAI researcher Will Depue says specialized ML got "bitter lessoned"

Key Takeaways

  • Reach: Will Depue's two posts have about 597 and 566 likes and 59K and 37K views; Freda Duan's "10 takes" has about 455 likes, 559 bookmarks and 84K views (as of 19:10 SGT)
  • RoboDojo: over 42 tasks and 2,100 trials, Astra averages 22.48% success (Score 28.97), ranking above all 40 public policies; GPT-5.5 gets 0.88% in the same setup (arXiv 2609.24170, as reported by the paper's authors)
  • Counterpoint: in the EBench report, Astra with single-shot in-context learning scores 46.7%, behind OpenWAM-alpha at 55.3% and AMapbot 1 at 48.9% (EBench tech report)
  • Real arms: Robocurve measured 19 of 20 successes on a block-into-bowl task on YAM arms at about $0.94 per run, but only 2 of 20 on a puzzle insertion task (Robocurve)
  • Weak spots: several evaluations find Astra clearly weaker on high-precision control, dynamic control and bimanual coordination
Read full story