Earlier quoted context omitted.
That is what we pay managers -to figure out- for. They should find out which and how by knowing the team, familiarity with domain knowledge, understanding company dynamics, understanding customer, understanding market dynamics.
That's basically a non-answer. Measuring "productivity" is a well known hard problem, and managers haven't really figured it out...
Google CEO says more than a quarter of the company's new code is created by AI
211–220 of 1001 posts
Re: Google CEO says more than a quarter of the company's new code is created by AI
#212To my experience, AIs can generate perfectly good code relatively easy things, the kind you might as well copy&paste from stackoverflow, and they'll very confidently generate subtly wrong code for anything that's non-trivial for an experienced programmer to write. How do people deal with this? I simply don't understand the value proposition. Does Google now have 25% subtly wrong code? Or do they have 25% trivial code…
I'd be terribly scared to use it in a language that isn't statically typed with many, many compile time error checks. Unless you're the type of programmer that is writing sabots all day (connecting round pegs into square holes between two data sources) you've got to be very critical of what these things are spitting out.
Re: Google CEO says more than a quarter of the company's new code is created by AI
#213Re: Google CEO says more than a quarter of the company's new code is created by AI
#214To my experience, AIs can generate perfectly good code relatively easy things, the kind you might as well copy&paste from stackoverflow, and they'll very confidently generate subtly wrong code for anything that's non-trivial for an experienced programmer to write. How do people deal with this? I simply don't understand the value proposition. Does Google now have 25% subtly wrong code? Or do they have 25% trivial code…
This, imho, is what is happening. In the olden days, when StackOverflow + Google used to magically find the exact problem from the exact domain you needed every time - even then you'd often need to sift through the answers (top voted one was increasingly not what you needed) to find what you needed, then modify it further to precisely fit whatever you were doing. This worked fine for me for a long time until search rendered itself worthless and the overall answer quality of StackOverflow has gone down (imo). So, we are here, essentially doing the exact same thing in a much more expensive way, as you said.
Regarding future employment opportunities - this rot is already happening and hires are coming from it, at least from what I'm seeing in my own domain.
Re: Google CEO says more than a quarter of the company's new code is created by AI
#215Re: Google CEO says more than a quarter of the company's new code is created by AI
#216How much code was "written by" autocomplete before LLMs came along? From my experience, LLM integration is advanced autocomplete. 25% is believable, but misleading.
Re: Google CEO says more than a quarter of the company's new code is created by AI
#217Did AI have to go thru several rounds of Leetcode interviews?
Re: Google CEO says more than a quarter of the company's new code is created by AI
#218Re: Google CEO says more than a quarter of the company's new code is created by AI
#219Earlier quoted context omitted.
We collectively deride leetcoding interviews yet ask AI to flawlessly solve leetcode questions. I bet I'd make more errors on my first try at it.
Writing a prime-number factorization function is hardly "leetcode".
Re: Google CEO says more than a quarter of the company's new code is created by AI
#220Earlier quoted context omitted.
You can come up with measures for it and then watch them, that’s for sure.
when metric becomes the target it ceases to be a good metric. when discovered how it works developers will type the first character immediately after opening the log. edit: typo
That is, I, personally, am not measured on how much AI generated code I create, and while the number is non-zero, I can't tell you what it is because I don't care and don't have any incentive to care. And I'm someone who is personally fairly bearish on the value of LLM-based codegen/autocomplete.