Andrej Karpathy argued that simple LLM coding tests are obsolete. Given the first paragraph of The Lord of the Rings and a 1M-token budget, Opus 5 ran autonomously for two hours and produced 5,500 lines of procedural Three.js 3D rendering code.

Key Takeaways

  • ✓Frontier coding models possess the stamina to autonomously generate 5,500+ lines of custom 3D code over hours.
  • ✓Simple coding benchmarks are obsolete for measuring modern long-horizon agent performance.
  • ✓Highlights the next frontier: native multimodal visual verification and interactive game testing.
🧭

Turn your technical choice into a development budget

Compare 40 dev plans & simulate token costs vs $20/mo subscriptions

Action HubReady to adopt this in production?

Benchmark side-by-side against alternatives, or calculate monthly token cost vs subscription break-even.

Up NextKarpathy builds HackerTube in about 2 hours with Claude Code and Opus 5.5: a YouTube clone of 6,454 videos recommended on Hacker News
Read Now→