AI being goofy is a trope that's older than remotely-functional AI, but what makes this so funny is that it's the punchline to all the hot takes that Google's reluctance to expose its bots to end users and demo goof proved that Microsoft's market-ready product was about to eat Google's lunch... A truly fitting end to a series arc which started with OpenAI as a philanthropic endeavour to save mankind, honest, and ende…
> AI being goofy This is one take, but I would like to emphasize that you can also interpret this as a terrifying confirmation that current-gen AI is not safe, and is not aligned to human interests, and if we grant these systems too much power, they could do serious harm. For example, connecting a LLM to the internet (like, say, OpenAssistant) when the AI knows how to write code (i.e. viruses) and at least in princip…
LLMs are not a general-purpose AI. They cannot make outbound connections, they are only "not aligned to human interests" in that they have no interests and thus cannot be aligned to anyone else's, and they cannot do any harm that humans do not deliberately perpetrate beyond potentially upsetting or triggering someone with a response to a prompt.
If Bing is talking about harming people, then it is because that is what its training data suggests would be a likely valid response to the prompt it is being given.
These ML text generators, all of them, are nothing remotely like the kind of AI you are imagining, and painting them as such does more real harm than they can ever do on their own.