Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

artificialintelligence-news.com

Post reply on HN
Print view View original

41–50 of 122 posts

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#41

Post by SatvikBeri »

908B64B197 wrote: post #3

I recall an AI playing a game that, just before losing, would press the "menu" button to pause the game and then stop doing anything. It fulfilled it's goal (not lose). That behavior should set expectations when it comes to AI. Also, am-I the only one that thinks this whole "chat bot having a natural conversation to book an appointment" is useless when a simple date-picker would do?

Two minute papers has many fun examples of AIs with unexpected behavior, OpenAI's hide and seek is one of my favorites: https://www.youtube.com/watch?v=Lu56xVlZ40M

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#42

Post by 40four »

908B64B197 wrote: post #3

I recall an AI playing a game that, just before losing, would press the "menu" button to pause the game and then stop doing anything. It fulfilled it's goal (not lose). That behavior should set expectations when it comes to AI. Also, am-I the only one that thinks this whole "chat bot having a natural conversation to book an appointment" is useless when a simple date-picker would do?

That sounds like the AI equivalent of 'flipping the table'!

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#44

Post by Mengkudulangsat »

908B64B197 wrote: post #3

I recall an AI playing a game that, just before losing, would press the "menu" button to pause the game and then stop doing anything. It fulfilled it's goal (not lose). That behavior should set expectations when it comes to AI. Also, am-I the only one that thinks this whole "chat bot having a natural conversation to book an appointment" is useless when a simple date-picker would do?

I had a client trying to build this.

A) An AI can be given the decision tree in English, but facilitate the date-picking conversation in many languages

B) Small businesses (think hairdressers, saloons) don't have dedicated receptionists. So the AI's job is to filter requests and put them into buckets so that employees can process them more efficiently.

C) Small businesses need something that works with WhatsApp. Date pickers are hard to integrate with that.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#46

Post by airhead969 »

renewiltord wrote: post #18

On the other hand, maybe that was the true cure for the condition and we, as humans, are too short sighted to see it because we have biological imperatives preventing us from doing the things that need to be done. Nah, it's just a chatbot.

That's one hell of a panacea that's always successful.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#47

Post by rmrfrmrf »

wizzwizz4 wrote: post #15
908B64B197 wrote: post #10

Earlier quoted context omitted.

I didn't know it was made for a joke conference! But it does illustrates how it's easy to get trapped into a local minima.

They're doing what you tell them to, not what you want them to. Same with GPT-3; it's predicting what (from its experience) it thinks a human would say, not what is ethical to say.

unless...

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#48

Post by aninuth »

Recently read an article about how the Trevor Project (hotline for LGBT+ youth) was starting to implement GPT-2 "patients" in their training routine for volunteers. While they aren't using it in public-facing contexts (yet), it's pretty scary to imagine the implications of depending on this stuff more and more.

https://www.technologyreview.com/2021/02/26/1020010/trevor-p...

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#49

Post by [deleted] »

aninuth wrote: post #48

Recently read an article about how the Trevor Project (hotline for LGBT+ youth) was starting to implement GPT-2 "patients" in their training routine for volunteers. While they aren't using it in public-facing contexts (yet), it's pretty scary to imagine the implications of depending on this stuff more and more. https://www.technologyreview.com/2021/02/26/1020010/trevor-p...

[deleted]

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#50

Post by scoopertrooper »

alacombe wrote: post #43
arbirk wrote: post #34

To be fair, it was a trick question

To be fair, GTP-3 is, by actual human standard, totally stupid.

Many humans, by actual human standards, aren't as far ahead as we'd like to think.
Post reply on HN