Vals AI says OpenAI used its Legal Research Bench to validate Astra for Law. OpenAI-reported results show Astra for Law ahead of GPT-6 Astra with web search at every price point: 90.0% versus 84.1% on the weighted rubric and 53.7% versus 39.6% all-pass; Vals is validating the claim on a held-out set.

Key Takeaways

  • ✓OpenAI reports Astra for Law at 90.0% on Vals weighted legal-research scoring versus 84.1% for GPT-6 Astra with web search.
  • ✓The reported all-pass rate is 53.7% versus 39.6%, pending Vals validation on a held-out set.
  • ✓The result shows how specialized instructions, tools, and retrieval configuration can materially change model benchmark and price comparisons.
⚡

Key Decision Metrics at a Glance

TL;DR Verdict
🏆 Benchmark RankRank
OpenAI reports Astra for Law at 90.0% on Vals weighted legal-research scoring versus 84.1% for GPT-6 Astra with web search.
Full Leaderboard→
💰 Cost & PlansCompare
The result shows how specialized instructions, tools, and retrieval configuration can materially change model benchmark and price comparisons.
Compare Plans↗
🛠️ Ecosystem & IDERules
Vals AI · Legal Research Bench · Astra for Law
Setup IDE Rules↗
🧭

Turn your technical choice into a development budget

Compare 40 dev plans & simulate token costs vs $20/mo subscriptions

⚔️ Compare Model→💰 Compare plans & limits↗
Action HubReady to adopt this in production?

Benchmark side-by-side against alternatives, or calculate monthly token cost vs subscription break-even.

⚔️ Launch VS Compare→💳 View Plans↗
Up NextX Discussion: MIT Team Says GPT-6 Astra Can Read and Write Neural Network Weights, Editing 0.016% of Qwen3.5-0.8B to Lift MATH-500 From 7.9% to 48.1%
Read Now→