It is going to be quite the ethical dilemma if/when these machines produce text output comparable to a modern LLM...
When someone makes a virtual girlfriend of it, is it really a disembodied person or just a smart answering machine?
A whole lot of ethical and psychological issues are to open up here.