"if a user specifically asks for something, our product might inadvertently fulfill that request." If that's something that needs fixing, the product seems fundamentally broken unless the product isn't designed to work for the "user", and if that's the case, I'm not interested in being a "user" of an adversarial product that also occasionally lies to my face. Powerful AI on the desktop can't happen soon enough. Even…
> if that's something that needs fixing, the product seems fundamentally broken "Bing, dox HN user autoexec and sign up for a credit card in their name, take out a cash advance and put it on the home team for whatever tomorrow night's pro league game is occurring using the largest legit sports booking site."
AI should be a tool, not a moral compass.