Benchmark1d ago
X Discussion: roon Says "Sparks" of an AI Ability Mean It Is Months to Years From Superhuman, and "You Are Almost Always Underhyping"
roon (@tszzl), a well-known AI account with about 500,000 followers, posted on November 2: "when you see “sparks” of any ability in ai models that means you’re months-years from it being superhuman at it. today grade school math, tomorrow navier stokes. it is hard to overhype these results. you are almost always underhyping no matter what." Within about five hours it drew nearly 2,000 likes and 59,000 views. Adam Karvonen, a researcher at Truthful AI and former Anthropic Fellow, pushed back that the domains where models are superhuman are verifiable, easy to simulate and fast to get feedback on, and that research taste, robotics or running companies may not move as fast. This is a debate between personal views, not any company's official position.
Benchmark2d ago
X Discussion: MIT Team Says GPT-6 Astra Can Read and Write Neural Network Weights, Editing 0.016% of Qwen3.5-0.8B to Lift MATH-500 From 7.9% to 48.1%
On November 2, MIT CSAIL PhD student Rikiya Takehi posted "Weight-Space Programming" on X: a team (Takehi, Jayden Teoh, Alex Zhang, Omar Khattab) had GPT-6 Astra read and edit neural network weights directly, with no gradients or training. Their blog says Astra changed only 131,072 weights (0.016%) of Qwen3.5-0.8B, fixed its thinking loops and raised MATH-500 from 7.9% to 48.1%. The post drew about 24K likes and 1.77M views, and Ethan Mollick quoted it saying it is a big deal pending replication. All results are self-reported by the authors and not yet independently reproduced.
Benchmark2d ago
OpenAI Introduces LifeVal, a Benchmark for Everyday Life Tasks Built From Time-Use Studies and a 3,995-Person Survey
On November 2 OpenAI published LifeVal, an evaluation of whether AI can actually get everyday tasks done for ordinary people, such as finding childcare, accessing government services, budgeting, ordering groceries and adapting recipes. The task list draws on the American Time Use Survey, the Multinational Time Use Study and a new demographically representative OpenAI survey of 3,995 people. OpenAI says it has used LifeVal for the past year to track and improve its models, and it lists several best recorded GPT-6 Astra task scores, many at 100%. All scores are vendor-reported and have not been independently reproduced.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.