Earlier quoted context omitted.
A reliable system will need a relatively formal “proof” that what it does is correct. Code is currently the easiest and most convenient encoding for lots of folks to express such logic. So they’ll need to learn to read the syntax even if they write less of it. So I think people will be able to put together lots of code with AI and not much programming experience, but there will be a need to ensure that it does the ri…
I really want to say you're right, but I'm afraid it's not necessarily true. Before we had computers and machines, humans did all the work. And you can't really reliably "code" humans. They misunderstand instructions. They disobey rules and regulations. They make mistakes. But society still strived with these unreliable humans that have no "proof" whatsoever that they'll do the job properly. In fact, these days we st…
I think we’ll always have code that will need to be “formal” and deterministic. Banks, voting machines, cryptography, pacemakers, rockets, etc may all need the kind of “precise” software we have today. Precise software for precise machines.
I’m now wondering if there may be a new category of programs, that are more wishy-washy yet useful in the kind of way an LLM can be today. Computer games aren’t really mission critical, for example, and I imagine we’ll see deep learning models and LLMs embedded one day. I could imagine a kid generating game logic, maps, content, etc through a more intuitive and less formal interface. I already get ChatGPT to help me cook dinner or any other number of less precise tasks. Who knows what other new kinds of automation may be this way - to produce something “good enough” like a person would.