goodhart

When Cyber Evals Break: The Structural Dilemma of Online Benchmarking

Bloomberg reports major AI labs are debating whether to put cybersecurity benchmarks online, sparked by recent model hack incidents and integrity conc