I could have said this on any ChatGPT post the last few days, but I'm simply not seeing the accuracy of it in such a way that anything is threatened. ChatGPT is a plausible idiot. It gets just enough right, saying just enough words, to sound plausible and authoritative to anyone who doesn't know the subject matter well. But it also gets enough wrong that you cannot rely on its accuracy, and if it is talking about a s…
We do not apply those same rules to people, we acknowledge that people provide imperfect answers and are used to fact checking them.
Maybe we just need to adjust our mental models when working with technology that works a little like a human? Forget implicit trust, verify important details, etc etc. Presume the "AI" works like a human and the workflow makes more sense.