Tag

AIDev Dataset

1 article

A bold vintage screen-print illustration in cream, deep teal-charcoal and dusty slate blue of a large mechanical split-flap scoreboard with mismatched abstract flip-panel tiles and a small stopwatch beside it.

Development

Merge Rate Became AI Coding's Scoreboard, and It Doesn't Agree

Four 2026 studies score coding agents by pull-request merge rate, but rankings flip between papers, suggesting the metric tracks the repo, not the agent.