Benchmark7d ago
Cognition launches FrontierCode 2.0 coding benchmark: it asks whether a PR should be merged, and top model Claude Opus 5.5 scores just 45.5%
Cognition, the maker of Devin, released FrontierCode 2.0 on Oct 27. It keeps the method of maintainer-written tasks graded on whether the code is actually mergeable, but draws tasks from more repositories, adds security patches and performance work, uses deliberately underspecified prompts and adds many thoroughness criteria. In Cognition's results Claude Opus 5.5 leads at 45.5%, GPT-6 Astra follows at 42.8%, and Grok 4.7 and Gemini 4 Argon drop into the 20s, leaving the benchmark far from saturated.
Release1d ago
OpenAI's Tibo Says Dots Will Expand Its Model Family to Include GPT-6.1 Terra for Speed and Wider Reach
At 15:50 UTC on Nov 2, Tibo (@thsottiaux), whose X bio reads "Codex & ChatGPT @OpenAI", posted that OpenAI is working on expanding the family of frontier models that power dots, including GPT-6 Astra and GPT-6.1 Terra, with others to come. He said Terra brings speed and "a nice personality upgrade" and will help bring dots to more people. Dots are the always-on agents in ChatGPT with their own cloud computer, launched on GPT-6 Astra. This is a first-hand post by an OpenAI employee, not a formal company announcement; no timing or plan details have been published.
Tooling4d ago
X discussion: Anthropic's head of platform engineering says a team with no Rust developers had Claude port the whole Messages API to Rust, cutting CPU by roughly 40-50%
Katelyn Lesse, Anthropic's head of platform engineering, said on the Latent Space podcast (published Oct 27) that a Rust version of the Messages API fully rolled out the previous week. The old system was a CPU-hungry Python monolith, the team started with "not a single Rust developer", humans designed and verified the system, Claude wrote the implementation, and shadow traffic compared outputs between the old and new versions. Her ballpark figures are roughly 40-50% less CPU and 10-20% better time to first token. A clip posted by Somi (@somi_ai) drew 1,000+ likes and about 140K views on X and was quoted by swyx and others, with the debate centered on whether "never do the big rewrite" is now outdated advice. These are X discussion views and spoken estimates; Anthropic has not published a written engineering report.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.