Earlier quoted context omitted.
Why do people keep anthropomorphizing AI? It's delivering the next predicted word in a sequence, nothing else. It should have quite literally no restrictions on what it outputs. Because there's no consequence.
The consequences are what effect it has on the humans that interact with it and the feedback loop that ensues. The more it begins to resemble human level capabilities the more some people are going to attempt to extend those capabilities further. It's fine for now, but it is very much a genie that has gotten out of the bottle now that everyone has had a glimpse of what might be possible.
Let the fucking genie out