LLM
OpenAI: 34% of SWE-Bench Pro Tasks Are Broken
249 broken tasks in SWE-Bench Pro's 731-task split. Your model comparison table just lost its foundation.
developers.pl
On AI-assisted development and Developer Experience
Tagged with
249 broken tasks in SWE-Bench Pro's 731-task split. Your model comparison table just lost its foundation.