yikes
Google CEO says more than a quarter of the company's new code is created by AI
441–450 of 1001 posts
Re: Google CEO says more than a quarter of the company's new code is created by AI
#442Hi, I lead the teams responsible for our internal developer tools, including AI features. We work very closely with Google DeepMind to adapt Gemini models for Google-scale coding and other Software Engineering usecases. Google has a unique, massive monorepo which poses a lot of fun challenges when it comes to deploying AI capabilities at scale. 1. We take a lot of care to make sure the AI recommendations are safe and…
I'm continually surprised by the amount of negativity that accompanies these sort of statements. The direction of travel is very clear - LLM based systems will be writing more and more code at all companies. I don't think this is a bad thing - if this can be accompanied by an increase in software quality, which is possible. Right now its very hit and miss and everyone has examples of LLMs producing buggy or ridiculou…
> The direction of travel is very clear
And if we get 9 women we can produce a baby in a single month.
There's no guarantee such progression will continue. Indeed, there's much more evidence it is coming to a a halt.
Re: Google CEO says more than a quarter of the company's new code is created by AI
#443[deleted]
Re: Google CEO says more than a quarter of the company's new code is created by AI
#444To my experience, AIs can generate perfectly good code relatively easy things, the kind you might as well copy&paste from stackoverflow, and they'll very confidently generate subtly wrong code for anything that's non-trivial for an experienced programmer to write. How do people deal with this? I simply don't understand the value proposition. Does Google now have 25% subtly wrong code? Or do they have 25% trivial code…
Or alternatively you don't know how to use AI to help you code and are in the 2020s equivalent of the 'Why do I need google when I have the yellow pages?' phase a lot of adults went through in the 2000s.
This is not a bad thing since you can improve, but constantly dismissing something that a lot of people are finding an amazing productivity boost should give you some pause.
Re: Google CEO says more than a quarter of the company's new code is created by AI
#445Earlier quoted context omitted.
Exactly, you write them with AI
IDEs have been auto completing braces, inserting imports and generating framework boilerplate for decades. We don’t need AI for this and it’s 10x the compute to do it slower with AI. LLMs are useful but they aren’t a silver bullet. We don’t need to replace everything with it just because.
Yeah, but the management achievement is to call 'autocomplete' AI.
AI doesn't mean LLM after all. AI means 'a computer thing'.
Re: Google CEO says more than a quarter of the company's new code is created by AI
#446Earlier quoted context omitted.
Heh, but it can't be that, no reason to think llms can count brackets needing a close any more than they can count words.
Logically, it couldn't be 50% since that would imply that the other 50% would be open brackets and that would leave 0% room for macros.
That's just a rounding error ;)
Re: Google CEO says more than a quarter of the company's new code is created by AI
#447Earlier quoted context omitted.
> Can you spot all the problems? You were probably being rhetorical, but there are two problems: - `p = 2` should be outside the loop - `prime_factors.append(n)` appends `1` onto the end of the list for no reason With those two changes I'm pretty sure it's correct.
`n` isn't defined
The implicit context that the poster removed (as you can tell from the indentation) was a function definition:
def factorize(n):
...
return prime_factorsRe: Google CEO says more than a quarter of the company's new code is created by AI
#448To my experience, AIs can generate perfectly good code relatively easy things, the kind you might as well copy&paste from stackoverflow, and they'll very confidently generate subtly wrong code for anything that's non-trivial for an experienced programmer to write. How do people deal with this? I simply don't understand the value proposition. Does Google now have 25% subtly wrong code? Or do they have 25% trivial code…
> the kind you might as well copy&paste from stackoverflow This bothers me. I completely understand the conversational aspect - "what approach might work for this?", "how could we reduce the crud in this function?" - it worked a lot for me last year when I tried learning C. But the vast majority of AI use that I see is...not that. It's just glorified, very expensive search. We are willing to burn far, far more fuel t…
> because we've decided we can't be bothered with traditional search
Traditional search was only Google, and Google figured out that they don't need to improve their tools to make it better, because everyone will continue to use it as a force of habit (google is a verb!). Traditional search is being abandoned because traditional search isn't good enough for the kinds of search we need (also, while google may claim their search is very useful, people rarely search stuff nowadays, instead prefer being passively fed content via recommendations algorithm (that also use AI!))
Re: Google CEO says more than a quarter of the company's new code is created by AI
#449To my experience, AIs can generate perfectly good code relatively easy things, the kind you might as well copy&paste from stackoverflow, and they'll very confidently generate subtly wrong code for anything that's non-trivial for an experienced programmer to write. How do people deal with this? I simply don't understand the value proposition. Does Google now have 25% subtly wrong code? Or do they have 25% trivial code…
[deleted]
Re: Google CEO says more than a quarter of the company's new code is created by AI
#450To my experience, AIs can generate perfectly good code relatively easy things, the kind you might as well copy&paste from stackoverflow, and they'll very confidently generate subtly wrong code for anything that's non-trivial for an experienced programmer to write. How do people deal with this? I simply don't understand the value proposition. Does Google now have 25% subtly wrong code? Or do they have 25% trivial code…
In my experience, that was always the case with gpt3.5, most times the case with gpt4, some times the case with the latest sonnet. It’s getting better FAST, and the kind of code they can handle is increasing fast too