Cognition says GPT-6 Astra is coming to Devin. On FrontierCode 1.1, Astra is within 0.4 points of Fable 5 at ~64% lower cost, and sets a new SOTA on Cognition’s internal testing benchmark with more comprehensive tests, clearer reports, and better video evidence.
Key Takeaways
- ✓Astra is coming to Devin for autonomous software engineering workflows.
- ✓FrontierCode 1.1: within 0.4 points of Fable 5 at ~64% lower cost.
- ✓New SOTA on Cognition’s internal testing bench: fuller tests, clearer reports, better video evidence.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.