Terminal-Bench
Terminal-Bench Flawed in 30% of Tasks; Scores Rise After Repairs
A Stanford audit found 28 defects in 89 Terminal-Bench 2.0 tasks. After fixes, 19 agents gained over 10 points, exposing benchmark maintenance debt.
1 article tagged with this topic
A Stanford audit found 28 defects in 89 Terminal-Bench 2.0 tasks. After fixes, 19 agents gained over 10 points, exposing benchmark maintenance debt.