Earlier quoted context omitted.
I think it becomes unethical once we see strong evidence that the system could be self-aware. Before that, it's just a simulation. Simulating storm activity doesn't make it rain.
It isn't a big leap to imagine a debate between aliens about whether the hairless apes on the third rock from Sol should be considered "sentient", or merely clever animals. I'd rather err far on the side of assuming sentience and personhood if there is a shadow of a doubt, simulated or otherwise.
But such a test does not work in a possibly-tainted environment. A neural net that seems to communicate might just have a hidden encoding of ELIZA.
You can err on the side of assuming sentience if you want, but don't think it's out of self-preservation-empathy-logic.