Loading
Loading articles
By Igor Slinko

AI summary
This research analyzes 4,782 real-world software engineering sessions to highlight the discrepancy between developer workflows and existing coding-agent benchmarks like SWE-Bench Pro. The authors introduce SWE-TaskFlow, a methodology to calibrate benchmarks based on empirical user interaction patterns, and provide a dataset to test agents against these more realistic task distributions.
Key points