METR Study Finds AI Coding Tools Slow Down Experienced Developers by 19%
A randomized controlled trial by METR involving 16 experienced developers found that AI coding tools like Cursor Pro actually increased task completion time by 19%, contrary to developers' expectations of 24% improvement. The study suggests AI tools may struggle with large, complex codebases and require significant time for prompting and waiting for responses.
Skynet Chance (-0.03%): The study demonstrates current AI coding tools have significant limitations in complex environments and may introduce security vulnerabilities, suggesting AI systems are less capable and reliable than assumed.
Skynet Date (+0 days): Evidence of AI tools underperforming in real-world complex tasks indicates slower than expected AI capability development, potentially delaying timeline for more advanced AI systems.
AGI Progress (-0.03%): The findings reveal that current AI systems struggle with complex, real-world software engineering tasks, highlighting significant gaps between expectations and actual performance in practical applications.
AGI Date (+0 days): The study suggests AI capabilities in complex reasoning and workflow optimization are developing more slowly than anticipated, potentially indicating a slower path to AGI achievement.
<< All AI news for July 11, 2025
Related AI News
- SpaceX Completes $60B Cursor Acquisition, Folding AI Coding Agents Into Its GPU Empire 2026-08-15
- Agentic Loops: The Shift Towards Continuous Self-Improving AI Swarms 2026-06-22
- Cognition Secures Massive $1B Funding Round to Scale Autonomous Coding Agent Devin 2026-05-27
- Corporate Layoffs Signal Acceleration of AI Agent Integration in the Workplace 2026-05-25
- OpenAI Enhances Codex with Desktop Control and Multi-Agent Capabilities to Compete with Anthropic 2026-04-16