Earlier quoted context omitted.
> I still think you will have to be a good developer to understand if the solution you get is good, but is that even going to matter when you can just ask again and try again? I think there will be lots of code bases that no-one really understands, but that it won't matter much. Really? If you have a million dollar bug because of one edge case and you are going to go to your AI and ask it to try again?
I've had experience lately of getting GPT4 to output some code, I notice there's a bug, I point out the bug (not even 'it's at this line with this variable', but just that it exists) and, yes, it does fix successfully fix it. So, yes, I think that's likely.
The issue take with it is that we are able to trust the output of AI models as we trust the output of optimizing compilers. It isn't even close that we can just fire and forget the prompt like I can code up something and trust that it 99,999% the optimizer produces the desired binary that works as intended.