Unverified50% confidenceBenchmarkExact time
On July 10, 2025, METR published a randomized controlled trial: 16 senior open-source developers handled 246 tasks on real repositories, and after using AI tools they were actually 19% slower, despite prior expectations of a 24% speedup and post-hoc self-reported estimates of a 20% speedup.
1
Sources
50%
Confidence
Long-term
Relevance
10/6/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedA study by METR found that senior engineers using AI for certain tasks were actually 19% slower, because time was spent on validation and correction.78% similarUnverifiedFrom June 2025 to May 2026, Cursor's share of enterprise AI coding tool spending tracked by Ramp fell from 41% to 26%, and JetBrains data showed workplace adoption rates declining from 18% to 12%.68% similarUnverifiedIn the fact-updating task, the success rate of the embedding retrieval method fluctuated between 0.30 and 0.95, with a maximum gap of 0.45 across different random seeds.67% similarUnverifiedAccording to shared data, the Shen Xiao I system reduced the time needed to handle matters by more than half, with an answer accuracy rate exceeding 95%.65% similarUnverifiedIn the LongMemEval benchmark, BM25 and embedding solutions converge to approximately 95% accuracy at 20 chunks65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/981297API
curl https://kongchang.com/api/v1/knowledge/claims/981297MCP
get_claim(id=981297)