Live data from Hacker News

Google CEO says more than a quarter of the company's new code is created by AI

businessinsider.com

641–650 of 1001 posts

Re: Google CEO says more than a quarter of the company's new code is created by AI

#641
post #73

Earlier quoted context omitted.

How would it know which edge cases are being useful and which ones aren't? I understand more code as being more edge cases

More code could just be useless code that no longer serves any purpose but still looks reasonable to the naked eye. An LLM can certainly figure out and suggest maybe some conditional is impossible given the rest of the code. I can also suggest alternatives, like using existing library functions for things that might have been coded manually.

Or just refactor to use early returns

Re: Google CEO says more than a quarter of the company's new code is created by AI

#642

When setting up unit tests traditionally took more time and LOC than the logic itself, LLMs are particularly useful. 1. Paste in my actual code. 2. Prompt: Write unit tests, test tables. Include scenarios: A, B, C, D, E. Include all other scenarios I left out, isolate suggestions for review. I used to spend the majority of the coding time writing unit tests and mocking test data, now it's more like 10%.

> Paste in my actual code.

> Prompt: Write unit tests

TDD in shambles. What you'd like is:

> Give your specs to some AI

> Get a test suite generated with all edge cases accounted for

> Code

Re: Google CEO says more than a quarter of the company's new code is created by AI

#643

Hi, I lead the teams responsible for our internal developer tools, including AI features. We work very closely with Google DeepMind to adapt Gemini models for Google-scale coding and other Software Engineering usecases. Google has a unique, massive monorepo which poses a lot of fun challenges when it comes to deploying AI capabilities at scale. 1. We take a lot of care to make sure the AI recommendations are safe and…

Is AI ready to crawl through all open source and find / fix all the potential security bugs or all bugs for that matter? If so will that become a commercial service or a free service? Will AI be able to detect bugs and back doors that require multiple pieces of code working together rather than being in a single piece of code? Humans have a hard time with this. - Hypothetical Example: Authentication bugs in sshd that…

No, that would require AGI. Actual reasoning.

Adversaries are already detecting issues tho, using proven means such as code review and fuzzing.

Google project zero consists of a team of rock star hackers. I don't see LLM even replacing junior devs right now.

Re: Google CEO says more than a quarter of the company's new code is created by AI

#644

Earlier quoted context omitted.

Because you are using it like that doesn't mean that it can't be used for the whole stack and on its own and the public including laymen such as the Nvidia CEO and Sam think that yes, we (I'm a dev) will be replaced. Plan accordingly my friend.

> Because you are using it like that doesn't mean that it can't be used for the whole stack Well no, but we have no evidence it can be used for the whole stack, whatever that means.

Even last year's gpt4 could make a whole iphone app from scratch for someone that doesn't know how to code. You can find videos online. I think you are applying the ostrich method which is understandable. We need to adapt.

Re: Google CEO says more than a quarter of the company's new code is created by AI

#645
post #537

Earlier quoted context omitted.

So this is basically the google CEO saying "a quarter of our terminal inputs is written by a glorified tab completion"?

Yes, isn't that the essential idea of industrialization and automation?

I think the critique here is that the AI currently deployed at Google hasn't meaningfully automated this user's life, because most IDEs already solved "very good autocomplete" more than a decade ago.

Re: Google CEO says more than a quarter of the company's new code is created by AI

#646
post #642

When setting up unit tests traditionally took more time and LOC than the logic itself, LLMs are particularly useful. 1. Paste in my actual code. 2. Prompt: Write unit tests, test tables. Include scenarios: A, B, C, D, E. Include all other scenarios I left out, isolate suggestions for review. I used to spend the majority of the coding time writing unit tests and mocking test data, now it's more like 10%.

> Paste in my actual code. > Prompt: Write unit tests TDD in shambles. What you'd like is: > Give your specs to some AI > Get a test suite generated with all edge cases accounted for > Code

Matter of preference. I've found TDD to be inflexible for my working style. But your suggestion would indeed work for a staunch TDD practitioner.

Re: Google CEO says more than a quarter of the company's new code is created by AI

#647
post #366

Earlier quoted context omitted.

The difference is that when we humans learn from our errors, we learn how to make them less often. LLMs get their errors fed back into them and become more confident that their wrong code is right. I'm not saying that's completely unsolvable, but that does seem to be how it works today.

That isn't the way they work today. LLMs can easily find errors in outputs they themselves just produced. Start adding different prompts, different models and you get all kinds of ways to catch errors. Just like humans.

You said humans are machines that make errors ans that LLMs can easily find errors in output they themself produce.

Are you sure you wanted to say that? Or is the other way around?

Re: Google CEO says more than a quarter of the company's new code is created by AI

#648

Earlier quoted context omitted.

Does it make you 25% more productive?

If 25% of code was AI-written, wouldn't it be a 33[.333...]% increase in productivity?

It is not a direct correlation. I might write 80% of the lines of code in a week, then spend the next 6 months on the remaining 20%. If the AI was mostly helpfull in that first week, overall productivity gain would be very low.

Re: Google CEO says more than a quarter of the company's new code is created by AI

#649

Earlier quoted context omitted.

> Because you are using it like that doesn't mean that it can't be used for the whole stack Well no, but we have no evidence it can be used for the whole stack, whatever that means.

Even last year's gpt4 could make a whole iphone app from scratch for someone that doesn't know how to code. You can find videos online. I think you are applying the ostrich method which is understandable. We need to adapt.

Complexity increase over time. I can create new features in minutes for my new selfhosted projects, equivalent work on my entreprise work takes days...
Post reply on HN