SWE-bench Saturation and the Shift to Pro
OpenAI Frontier Evals leaders explain why SWE-bench Verified is saturated and contaminated, driving the industry toward SWE-bench Pro. The discussion covers benchmark evolution, contamination detection, and the need for harder, real-world coding evaluations.