The gist ("product becomes a black box") applies to any abstraction. It could apply to high-level languages (including so-called "low-level" languages like C), and few people criticize those. But LLMs are particularly insidious because they're a particularly leaky abstraction. If you ask an LLM to implement something: - First, there's only a chance it will output something that works at all - Then, it may fail on edg…
I agree, there is a reason we settled on programming languages as a interface to instruct the machine. Ultimately it is a tool to indicate our thoughts as precise as possible in a certain domain. People that don't understand the tools they use are doomed to reinvent them. Perhaps the interface will evolve into pseudo code where AI will fill in undefined or boilerplate with best estimates.
Having reinvented them, they will understand. In this way, human progress is unstoppable, even with knowledge micro (and macro) dark ages.