Earlier quoted context omitted.
> What LLMs have made me realize more than anything is that we just don't care that much the information we receive being completely factual. I find this highly concerning but I feel similar. Even "smart people" I work with seem to have gulped down the LLM cool aid because it's convenient and it's "cool". Sometimes I honestly think: "just surrender to it all, believe in all the machine tells you unquestionably, forge…
The smart people I've seen using ChatGPT always double check the facts it gives. However, the truth is that RLHF works well to extinguish these lies over time. As more people use the platform and give feedback, the thing gets better. And now, I find it to be pretty darn accurate.
I don't like being told lies in the first place and having to unlearn it.
It doesn't help that I might as well have just gone straight to the "verification" instead.