Live data from Hacker News

Google CEO says more than a quarter of the company's new code is created by AI

businessinsider.com

121–130 of 1001 posts

Re: Google CEO says more than a quarter of the company's new code is created by AI

#121
Github Copilot had an outage for me this morning. It was kind of shocking. I now believe this metric. :-)

I'll be looking into ways of running a local LLM for this purpose (code assistance in VS Code). I'm already really impressed with various quite large models running on my 32 GB Mac Studio M2 Max via Ollama. It feels like having a locally running chatgpt.

Re: Google CEO says more than a quarter of the company's new code is created by AI

#122
post #106

Earlier quoted context omitted.

I'm continually surprised by the amount of negativity that accompanies these sort of statements. The direction of travel is very clear - LLM based systems will be writing more and more code at all companies. I don't think this is a bad thing - if this can be accompanied by an increase in software quality, which is possible. Right now its very hit and miss and everyone has examples of LLMs producing buggy or ridiculou…

> if this can be accompanied by an increase in software quality That’s a huge “if”, and by your own admission not what’s happening now. > other LLM agents reviewing code, feeding in compile errors, letting other LLM agents interact with the produced code, etc. What a stupid future. Machines which make errors being “corrected” by machines which make errors in a death spiral. An unbelievable waste of figurative and lit…

> What a stupid future. Machines which make errors being “corrected” by machines which make errors in a death spiral. An unbelievable waste of figurative and literal energy.

Humans are machines which make errors. Somehow, we got to the moon. The suggestion that errors just mindlessly compound and that there is no way around it, is what's stupid.

Re: Google CEO says more than a quarter of the company's new code is created by AI

#126
maps with recent headlines about AI improving programmer productivity 20-30%.

which puts it in line with previous code-generation technologies i would imagine. I wonder which of these increased productivity the most?

- Assembly Language

- early Compilers

- databases

- graphics frameworks

- ui frameworks (windows)

- web apps

- code generators (rails scaffolding)

- genAI

Re: Google CEO says more than a quarter of the company's new code is created by AI

#127
To my experience, AIs can generate perfectly good code relatively easy things, the kind you might as well copy&paste from stackoverflow, and they'll very confidently generate subtly wrong code for anything that's non-trivial for an experienced programmer to write. How do people deal with this? I simply don't understand the value proposition. Does Google now have 25% subtly wrong code? Or do they have 25% trivial code? Or do all their engineers babysit the AI and bugfix the subtly wrong code? Or are all their engineers so junior that an AI is such a substantial help?

Like, isn't this announcement a terrible indictment of how inexperienced their engineers are, or how trivial the problems they solve are, or both?

Re: Google CEO says more than a quarter of the company's new code is created by AI

#128

To my experience, AIs can generate perfectly good code relatively easy things, the kind you might as well copy&paste from stackoverflow, and they'll very confidently generate subtly wrong code for anything that's non-trivial for an experienced programmer to write. How do people deal with this? I simply don't understand the value proposition. Does Google now have 25% subtly wrong code? Or do they have 25% trivial code…

Does the figure include unit tests?

Re: Google CEO says more than a quarter of the company's new code is created by AI

#129
post #111
post #109

Earlier quoted context omitted.

> For teams you can measure meaningful outcomes and improve team metrics. How? Which metrics?

That is what we pay managers -to figure out- for. They should find out which and how by knowing the team, familiarity with domain knowledge, understanding company dynamics, understanding customer, understanding market dynamics.

That's basically a non-answer. Measuring "productivity" is a well known hard problem, and managers haven't really figured it out...

Re: Google CEO says more than a quarter of the company's new code is created by AI

#130

To my experience, AIs can generate perfectly good code relatively easy things, the kind you might as well copy&paste from stackoverflow, and they'll very confidently generate subtly wrong code for anything that's non-trivial for an experienced programmer to write. How do people deal with this? I simply don't understand the value proposition. Does Google now have 25% subtly wrong code? Or do they have 25% trivial code…

By definition, "trivial" code should make up a significant portion of any code base, so perhaps the 25% is precisely the bit that is trivial and easily automated.
Post reply on HN