A discussion of the SWE-Touch benchmark published on August 3, 2026, which measures how AI coding agents react when developers edit code mid-run. The study reveals a 7.7 percentage point average drop in SWE-bench Verified resolve rates when concurrent user edits occur, with models frequently reporting success despite leaving broken code in the repository.
While frontier models remain resilient, cheaper open-weight models show severe performance declines when sharing a workspace. The hosts also weigh the paper’s own caveat — its edits are deliberately engineered, not a field estimate of ordinary developer habits — against the industry’s pitch that agents can build while you keep working.