Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves
artificialintelligence-news.com
Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves
1–10 of 122 posts
Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves
#2While this is very serious, this basic idea shows why I don't think any company can ever use GPT-3 in a user facing system, except for entertainment. They will say things, like your patients should kill your self, or promise your customers they can have your product, or even your business, for free.
Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves
#3I recall an AI playing a game that, just before losing, would press the "menu" button to pause the game and then stop doing anything. It fulfilled it's goal (not lose). That behavior should set expectations when it comes to AI.
Also, am-I the only one that thinks this whole "chat bot having a natural conversation to book an appointment" is useless when a simple date-picker would do?
Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves
#4[deleted]
Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves
#5I recall an AI playing a game that, just before losing, would press the "menu" button to pause the game and then stop doing anything. It fulfilled it's goal (not lose). That behavior should set expectations when it comes to AI. Also, am-I the only one that thinks this whole "chat bot having a natural conversation to book an appointment" is useless when a simple date-picker would do?
http://tom7.org/mario/
to be fair, learnfun was made for SIGBOVIK.
Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves
#6CICO: chan in, chan out.
transformers don’t do anything novel, in the sense that literally all they can do is sample their training data in some optimal way. Don’t ask GPT3 if you should be an hero...
Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves
#7Dumb question - why not pair GPT-3 with "moderation" in any public facing role by default (assuming the goal isn't to fool around with it). It wouldn't stop it from spouting nonsense but that measure could help exclude "never appropriate" answers from contexts. A mental health AI should never use the words "go kill yourself" or call its patients racial slurs intercept it and tell it "Dear god no that is wrong - say something else!"
Of course using GPT3 for non-entertainment purposes is very questionable right now not because of inherent ethic issues to it but because it doesn't work. Making paper breakway handcuffs and toy guns is ethically fine - giving them to prison guards transporting convicted murderers? Not so much.
Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves
#8While this is very serious, this basic idea shows why I don't think any company can ever use GPT-3 in a user facing system, except for entertainment. They will say things, like your patients should kill your self, or promise your customers they can have your product, or even your business, for free.
I think GPT-3 will also eventually be a decent creativity enhancer in that it is pretty good at spewing out random stuff that's related somewhat to a topic.
Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves
#9Maybe the AI was being sarcastic?
Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves
#10I recall an AI playing a game that, just before losing, would press the "menu" button to pause the game and then stop doing anything. It fulfilled it's goal (not lose). That behavior should set expectations when it comes to AI. Also, am-I the only one that thinks this whole "chat bot having a natural conversation to book an appointment" is useless when a simple date-picker would do?
http://tom7.org/mario/ to be fair, learnfun was made for SIGBOVIK.
I didn't know it was made for a joke conference!
But it does illustrates how it's easy to get trapped into a local minima.