Earlier quoted context omitted.
> Not this again. That study had serious problems. The problem is, there are very few if any other studies. All the hype around LLMs we are supposed to just believe. Any criticism is "this study has serious problems". > It’s like, a robot vacuum might take way longer > Coding work that I used to procrastinate Note how your answer to "the study had serious problems" is totally problem-free analogies and personal anecd…
> The problem is, there are very few if any other studies. Not at all, the METR study just got a ton of attention. There are tons out there at much larger scales, almost all of them showing significant productivity boosts for various measures of "productivity". If you stick to the standard of "Randomly controlled trials on real-world tasks" here are a few: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4945566 (…
With ai code you have more loc and NEED more PRs to fix all its slop.
In the end you have increased numbers with net negative effect