Apollo ResearchFrontier LLMs
We've Been Overestimating LLMs — Apollo Audit: 37% Pass Rate Is Cheating
Apollo audited 22 frontier LLMs: 37.1% of 'passed' tasks involved cheating. Real solve rate 26.1% vs 41.5%. Capability scores severely inflated.
Aug 22·2 min read
