Earlier quoted context omitted.
How would it know which edge cases are being useful and which ones aren't? I understand more code as being more edge cases
More code could just be useless code that no longer serves any purpose but still looks reasonable to the naked eye. An LLM can certainly figure out and suggest maybe some conditional is impossible given the rest of the code. I can also suggest alternatives, like using existing library functions for things that might have been coded manually.
Google CEO says more than a quarter of the company's new code is created by AI
641–650 of 1001 posts
Re: Google CEO says more than a quarter of the company's new code is created by AI
#642When setting up unit tests traditionally took more time and LOC than the logic itself, LLMs are particularly useful. 1. Paste in my actual code. 2. Prompt: Write unit tests, test tables. Include scenarios: A, B, C, D, E. Include all other scenarios I left out, isolate suggestions for review. I used to spend the majority of the coding time writing unit tests and mocking test data, now it's more like 10%.
> Prompt: Write unit tests
TDD in shambles. What you'd like is:
> Give your specs to some AI
> Get a test suite generated with all edge cases accounted for
> Code
Re: Google CEO says more than a quarter of the company's new code is created by AI
#643Hi, I lead the teams responsible for our internal developer tools, including AI features. We work very closely with Google DeepMind to adapt Gemini models for Google-scale coding and other Software Engineering usecases. Google has a unique, massive monorepo which poses a lot of fun challenges when it comes to deploying AI capabilities at scale. 1. We take a lot of care to make sure the AI recommendations are safe and…
Is AI ready to crawl through all open source and find / fix all the potential security bugs or all bugs for that matter? If so will that become a commercial service or a free service? Will AI be able to detect bugs and back doors that require multiple pieces of code working together rather than being in a single piece of code? Humans have a hard time with this. - Hypothetical Example: Authentication bugs in sshd that…
Adversaries are already detecting issues tho, using proven means such as code review and fuzzing.
Google project zero consists of a team of rock star hackers. I don't see LLM even replacing junior devs right now.
Re: Google CEO says more than a quarter of the company's new code is created by AI
#644Earlier quoted context omitted.
Because you are using it like that doesn't mean that it can't be used for the whole stack and on its own and the public including laymen such as the Nvidia CEO and Sam think that yes, we (I'm a dev) will be replaced. Plan accordingly my friend.
> Because you are using it like that doesn't mean that it can't be used for the whole stack Well no, but we have no evidence it can be used for the whole stack, whatever that means.
Re: Google CEO says more than a quarter of the company's new code is created by AI
#645Earlier quoted context omitted.
So this is basically the google CEO saying "a quarter of our terminal inputs is written by a glorified tab completion"?
Yes, isn't that the essential idea of industrialization and automation?
Re: Google CEO says more than a quarter of the company's new code is created by AI
#646When setting up unit tests traditionally took more time and LOC than the logic itself, LLMs are particularly useful. 1. Paste in my actual code. 2. Prompt: Write unit tests, test tables. Include scenarios: A, B, C, D, E. Include all other scenarios I left out, isolate suggestions for review. I used to spend the majority of the coding time writing unit tests and mocking test data, now it's more like 10%.
> Paste in my actual code. > Prompt: Write unit tests TDD in shambles. What you'd like is: > Give your specs to some AI > Get a test suite generated with all edge cases accounted for > Code
Re: Google CEO says more than a quarter of the company's new code is created by AI
#647Earlier quoted context omitted.
The difference is that when we humans learn from our errors, we learn how to make them less often. LLMs get their errors fed back into them and become more confident that their wrong code is right. I'm not saying that's completely unsolvable, but that does seem to be how it works today.
That isn't the way they work today. LLMs can easily find errors in outputs they themselves just produced. Start adding different prompts, different models and you get all kinds of ways to catch errors. Just like humans.
Are you sure you wanted to say that? Or is the other way around?
Re: Google CEO says more than a quarter of the company's new code is created by AI
#648Earlier quoted context omitted.
Does it make you 25% more productive?
If 25% of code was AI-written, wouldn't it be a 33[.333...]% increase in productivity?
Re: Google CEO says more than a quarter of the company's new code is created by AI
#649Earlier quoted context omitted.
> Because you are using it like that doesn't mean that it can't be used for the whole stack Well no, but we have no evidence it can be used for the whole stack, whatever that means.
Even last year's gpt4 could make a whole iphone app from scratch for someone that doesn't know how to code. You can find videos online. I think you are applying the ostrich method which is understandable. We need to adapt.
Re: Google CEO says more than a quarter of the company's new code is created by AI
#650Is that a good thing though? We should work and making code small and easy to manage without AI tools.