Live data from Hacker News

Google CEO says more than a quarter of the company's new code is created by AI

businessinsider.com

211–220 of 1001 posts

Re: Google CEO says more than a quarter of the company's new code is created by AI

#211
post #111

Earlier quoted context omitted.

That is what we pay managers -to figure out- for. They should find out which and how by knowing the team, familiarity with domain knowledge, understanding company dynamics, understanding customer, understanding market dynamics.

That's basically a non-answer. Measuring "productivity" is a well known hard problem, and managers haven't really figured it out...

It's not a non-answer. Good managers need to figure out what metrics make sense for the team they are managing, and that will change depending on the company and team. It might be new features, bug fixes, new product launch milestones, customer satisfaction, ad revenue, or any of a hundred other things.

Re: Google CEO says more than a quarter of the company's new code is created by AI

#212
post #207

To my experience, AIs can generate perfectly good code relatively easy things, the kind you might as well copy&paste from stackoverflow, and they'll very confidently generate subtly wrong code for anything that's non-trivial for an experienced programmer to write. How do people deal with this? I simply don't understand the value proposition. Does Google now have 25% subtly wrong code? Or do they have 25% trivial code…

I'd be terribly scared to use it in a language that isn't statically typed with many, many compile time error checks. Unless you're the type of programmer that is writing sabots all day (connecting round pegs into square holes between two data sources) you've got to be very critical of what these things are spitting out.

It is way more scary to use it for C or C++ than Python imo.

Re: Google CEO says more than a quarter of the company's new code is created by AI

#214

To my experience, AIs can generate perfectly good code relatively easy things, the kind you might as well copy&paste from stackoverflow, and they'll very confidently generate subtly wrong code for anything that's non-trivial for an experienced programmer to write. How do people deal with this? I simply don't understand the value proposition. Does Google now have 25% subtly wrong code? Or do they have 25% trivial code…

> To my experience, AIs can generate perfectly good code relatively easy things, the kind you might as well copy&paste from stackoverflow,

This, imho, is what is happening. In the olden days, when StackOverflow + Google used to magically find the exact problem from the exact domain you needed every time - even then you'd often need to sift through the answers (top voted one was increasingly not what you needed) to find what you needed, then modify it further to precisely fit whatever you were doing. This worked fine for me for a long time until search rendered itself worthless and the overall answer quality of StackOverflow has gone down (imo). So, we are here, essentially doing the exact same thing in a much more expensive way, as you said.

Regarding future employment opportunities - this rot is already happening and hires are coming from it, at least from what I'm seeing in my own domain.

Re: Google CEO says more than a quarter of the company's new code is created by AI

#216
post #190

How much code was "written by" autocomplete before LLMs came along? From my experience, LLM integration is advanced autocomplete. 25% is believable, but misleading.

My linux terminal tab-complete has written 50% of my code

Re: Google CEO says more than a quarter of the company's new code is created by AI

#219
post #167

Earlier quoted context omitted.

We collectively deride leetcoding interviews yet ask AI to flawlessly solve leetcode questions. I bet I'd make more errors on my first try at it.

Writing a prime-number factorization function is hardly "leetcode".

Empirical testing (for example: https://news.ycombinator.com/item?id=33293522) has established that the people on Hacker News tend to be junior in their skills. Understanding this fact can help you understand why certain opinions and reactions are more likely here. Surprisingly, the more skilled individuals tend to be found on Reddit (same testing performed there).

Re: Google CEO says more than a quarter of the company's new code is created by AI

#220
post #112
post #94

Earlier quoted context omitted.

You can come up with measures for it and then watch them, that’s for sure.

when metric becomes the target it ceases to be a good metric. when discovered how it works developers will type the first character immediately after opening the log. edit: typo

Only if the developer is being judged on the thing. If the tool is being judged on the thing, it's much less relevant.

That is, I, personally, am not measured on how much AI generated code I create, and while the number is non-zero, I can't tell you what it is because I don't care and don't have any incentive to care. And I'm someone who is personally fairly bearish on the value of LLM-based codegen/autocomplete.

Post reply on HN