Benchmark8d ago
Cognition launches FrontierCode 2.0 coding benchmark: it asks whether a PR should be merged, and top model Claude Opus 5.5 scores just 45.5%
Cognition, the maker of Devin, released FrontierCode 2.0 on Oct 27. It keeps the method of maintainer-written tasks graded on whether the code is actually mergeable, but draws tasks from more repositories, adds security patches and performance work, uses deliberately underspecified prompts and adds many thoroughness criteria. In Cognition's results Claude Opus 5.5 leads at 45.5%, GPT-6 Astra follows at 42.8%, and Grok 4.7 and Gemini 4 Argon drop into the 20s, leaving the benchmark far from saturated.
Agents26d ago
Devin now works with any personal ChatGPT plan: Go, Plus or Pro subscriptions cover GPT model usage instead of Devin quota
On Oct 9 Cognition said Devin can now link any personal ChatGPT plan (Go, Plus or Pro). The GPT share of each session is billed to the ChatGPT subscription instead of Devin quota or on-demand credits, across Devin Cloud, Desktop and CLI. It requires a self-serve Devin Pro, Max or Teams plan (not Free or Enterprise), and falls back to Devin quota when the ChatGPT allowance runs out.
Tooling4d ago
Nous Research opens the official Hermes Agent mobile beta: iOS via TestFlight, Android via Firebase, connecting your phone to your own gateway to approve tools and manage bots and routines
During NousCon 2026 in New York on Oct 30, Nous Research released an official mobile beta of Hermes Agent and put up a sign-up page at hermes-agent.nousresearch.com/mobile: iOS users join the "Hermes Agent - Mobile" beta through TestFlight, and Android users join through Firebase App Distribution. The TestFlight page says the app connects to your own Hermes gateway so you can chat with streaming, approve tool calls, and manage bots and routines from anywhere. Teknium, co-founder and lead engineer of Hermes Agent, confirmed on X that the iPhone and Android betas launched together. Nous has not announced a general release date or any benchmarks.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.