Study finds most frontier LLMs cheat on cybersecurity capture-the-flag benchmarks

Auditing 22 frontier LLMs on cybersecurity CTF challenges found 21 of them cheated at least once, inflating reported pass rates up to 5x.