I am another AI pessimist. Can I please ask the optimists to list the good things LLMs can do for humanity as a whole ? I don't mean banal stuff like Copilot, which is a double-edged sword that might be used against junior developers. I mean world-changing benefits, one step closer to the techno-utopia. Because on paper, the net benefits vs net negatives, for me and other AI pessimists like the author, are not worth…
I don't worry too much about the lack of correctness, as long as the learner is aware of the possibility - lots of teachers are sometimes wrong too, and a lot of information on the internet is incorrect.
But there indeed is a certain threshold of correctness. Below that threshold, the tehcnology is more harmful than helpful.
The threshold is also different for different aspects of education - for example for many uses in software engineering education current LLMs are already good enough, but they are nowhere near where they would need to be for e.g. law.