AI coding tools AI News & Updates
METR Study Finds AI Coding Tools Slow Down Experienced Developers by 19%
A randomized controlled trial by METR involving 16 experienced developers found that AI coding tools like Cursor Pro actually increased task completion time by 19%, contrary to developers' expectations of 24% improvement. The study suggests AI tools may struggle with large, complex codebases and require significant time for prompting and waiting for responses.
Skynet Chance (-0.03%): The study demonstrates current AI coding tools have significant limitations in complex environments and may introduce security vulnerabilities, suggesting AI systems are less capable and reliable than assumed.
Skynet Date (+0 days): Evidence of AI tools underperforming in real-world complex tasks indicates slower than expected AI capability development, potentially delaying timeline for more advanced AI systems.
AGI Progress (-0.03%): The findings reveal that current AI systems struggle with complex, real-world software engineering tasks, highlighting significant gaps between expectations and actual performance in practical applications.
AGI Date (+0 days): The study suggests AI capabilities in complex reasoning and workflow optimization are developing more slowly than anticipated, potentially indicating a slower path to AGI achievement.