Live data from Hacker News

The gauge broke: devs felt 20% faster with AI, measured 19% slower (2025)

intrepidkarthi.com

21–30 of 115 posts

Re: The gauge broke: devs felt 20% faster with AI, measured 19% slower (2025)

#21

My two bosses are anti-AI. Whenever I tell them about how awesome AI is, they come back with stories about how they used AI and it couldn't even do anything basic and what it did do had errors. People will always create a world narrative that matches what they already believe. Anti AI people are always quoting these "facts" about how AI reduces productivity even when developers feel it increases productivity - it rei…

But this isn’t just a narrative but a study. Limited but a study

Re: The gauge broke: devs felt 20% faster with AI, measured 19% slower (2025)

#22
post #15

Generation got cheap. Verification got expensive. That proves AI is capable of doing one part of the software engineering process. The 16 devs in the study trusted AI to write the code. Once we trust AI to do the verification as well we'll realise the gains we feel we're getting now. Essentially we're intentionally going slower on the second half because the trust is missing. Alternatively, rather than trusting AI to…

I wouldn’t even trust experienced developers to merge code without peer review.

Re: The gauge broke: devs felt 20% faster with AI, measured 19% slower (2025)

#27
post #5

This study was shown to be flawed at the time; METR has retracted it. And it doesn't take into account current frontier models. AI makes you more productive. This is no longer up for debate. The energy you spend arguing last year's talking points is better spent knuckling down and learning the tools.

So where are the profit jumps from all the productivity gains?

Or do you just produce more code but not more productive value?

Re: The gauge broke: devs felt 20% faster with AI, measured 19% slower (2025)

#28
post #21

My two bosses are anti-AI. Whenever I tell them about how awesome AI is, they come back with stories about how they used AI and it couldn't even do anything basic and what it did do had errors. People will always create a world narrative that matches what they already believe. Anti AI people are always quoting these "facts" about how AI reduces productivity even when developers feel it increases productivity - it rei…

But this isn’t just a narrative but a study. Limited but a study

A study from 2025. Might as well be from five years ago.

Re: The gauge broke: devs felt 20% faster with AI, measured 19% slower (2025)

#29

My two bosses are anti-AI. Whenever I tell them about how awesome AI is, they come back with stories about how they used AI and it couldn't even do anything basic and what it did do had errors. People will always create a world narrative that matches what they already believe. Anti AI people are always quoting these "facts" about how AI reduces productivity even when developers feel it increases productivity - it rei…

[deleted]

Re: The gauge broke: devs felt 20% faster with AI, measured 19% slower (2025)

#30

My two bosses are anti-AI. Whenever I tell them about how awesome AI is, they come back with stories about how they used AI and it couldn't even do anything basic and what it did do had errors. People will always create a world narrative that matches what they already believe. Anti AI people are always quoting these "facts" about how AI reduces productivity even when developers feel it increases productivity - it rei…

>feel

Productivity is not a feeling though. Either you show an increased productivity or it doesn't exist

Post reply on HN