They don't lie, because they don't ever have an understanding of truth vs any other language that sounds good. They don't cheat, because they can for example tell you the complete rules of chess, but don't know how to play chess without breaking those rules. They can recite rules, but they don't know what they are. They don't steal, because they don't understand ownership. In other words, they aren't intelligent. The…
Anthropomorphizing these models is doing immeasurable harm to society in ways we probably can’t event quantify right now.
As humans we’re already geared towards anthropomorphizing things, we do it to animals too!
And it always felt like giving these models a chat interface is really exploiting that tendency in us.