[flagged]
AutoDev: Automated AI-driven development by Microsoft
31–40 of 232 posts
Re: AutoDev: Automated AI-driven development by Microsoft
#32Re: AutoDev: Automated AI-driven development by Microsoft
#33I can see this being used for code much like ChatGPT is used for prose - to generate large amounts of meaningless output of low quality and dubious utility, serving to fulfill pointless metrics at best, and enabling bad actors at worst. As with prose, good human crafted content will always be highly valued and rewarded.
Counterexample for the sake of argument: photography almost entirely replaced human painting.
Re: AutoDev: Automated AI-driven development by Microsoft
#34Claude 3 Opus already scored around 85-86% on these benchmarks, without an "AutoDev" style agentic approach.
And all the same problems with HumanEval remain, the limitations in terms of what style of problems are chosen, and real world relevance.
I hate writing these styles of comments because I'm acutely aware that a part of me is just worried. Worried about the speed of progress and worried about a changing landscape.
But I still wonder how much of this stuff is going to be transferrable to a real life software context.
Re: AutoDev: Automated AI-driven development by Microsoft
#35Earlier quoted context omitted.
It would be like steering offshore teams, with the difference the team are now AI agents. Better look for architecture and management jobs, only a few select ones would still be allowed into the magic tower. Naturally after a heavy round of letcode interviews that have nothing to do with writing AI algorithms.
Management ? I'm not sure, if the AI makes engineers 10-20x more efficient, you will need way less engineers, and way less managers.
Re: AutoDev: Automated AI-driven development by Microsoft
#36Earlier quoted context omitted.
Because test define the behaviour. The hardest part of requirements is describing exactly what you want. Tests are great way of doing that. I think AI software development is going to involve writing tests, which the AI agents then get passing. Or some other requirements language that allows for exactness where English can fall down.
So we get to do the shitty part.
Re: AutoDev: Automated AI-driven development by Microsoft
#37If LLM/Agents contribute to software development, how does the role of software engineers evolve? SE should focus on : - System design - Integrations - Project management etc or the job will disappear in 10 years ?
Prompt Engineering! I'm kidding. Software engineering roles of the "glue things together" kind will evolve into a 'technical product' role, defining how systems work, especially at the edges where systems interact. Architects and staff engineers already do this. Lower down the food chain engineers who actually invent new things will do the same, only quicker if they have an AI tool assisting with the grunt work of te…
Sounds like the job of a programmer wouldn't go away very near term in such a scenario. It might well become far less glamorous, less "technical", and not as well paid though. Comparable to an accountant maybe.
As someone who started their career right after the dotcom bubble burst, various people asked me "Why are you doing this? There's no money in software anymore". Turns out there sure was. Back then I didn't know that, and I didn't care. I didn't get into it for the money, I got into it because I had a passion for it. Maybe it'll become more like back then again. Doesn't seem so bad to me.
Re: AutoDev: Automated AI-driven development by Microsoft
#38Earlier quoted context omitted.
Counterexample for the sake of argument: photography almost entirely replaced human painting.
Photography replaced painting for creating a realistic likeness, but painting as art had moved beyond that already. Photography became a new art form itself, alongside (instead of replacing) painting.
It did absolutely replace the need to commission someone to draw you, I guess. But that is a small subsection of what painting is and was.
Re: AutoDev: Automated AI-driven development by Microsoft
#39I can see this being used for code much like ChatGPT is used for prose - to generate large amounts of meaningless output of low quality and dubious utility, serving to fulfill pointless metrics at best, and enabling bad actors at worst. As with prose, good human crafted content will always be highly valued and rewarded.
Counterexample for the sake of argument: photography almost entirely replaced human painting.
Re: AutoDev: Automated AI-driven development by Microsoft
#40They are flowery language generators and they will never be able to reason, understand, debate and criticize. They know nothing and therefore embody nothing. No matter how much computer power you waste on them the end result will always be bullshit. Nothing more. Nothing less.
To Big Tech I say: Prove me wrong.