Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

artificialintelligence-news.com

Post reply on HN
Print view View original

101–110 of 122 posts

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#101

Post by boudin »

iujjkfjdkkdkf wrote: post #23

A couple things: 1. as I understand, GPT-x are trained on generic datasets. Why would anyone expect it could just be repurposed for a domain specific task, without additional fine tuning? Same as a lot of vision models are trained on Imagenet and then fine tuned for the application, but you would never expect that imagenet weights would just automatically perform whatever specific task you had. 2. Where would this ch…

Chatbots are used a lot already for simple tasks, like the one mentionned in this article (booking apointments online).

The issue is not that the bot is not able to replace a medical specialist, but making sure the bot will not answer something totally wrong in such a context. In this example, for a medical practice wanting to use a chatbot to automate apointments, you would want to be sure that it will never answer any other questions, especially sensitive ones.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#102

Post by DanBC »

iujjkfjdkkdkf wrote: post #23

A couple things: 1. as I understand, GPT-x are trained on generic datasets. Why would anyone expect it could just be repurposed for a domain specific task, without additional fine tuning? Same as a lot of vision models are trained on Imagenet and then fine tuned for the application, but you would never expect that imagenet weights would just automatically perform whatever specific task you had. 2. Where would this ch…

> . Where would this chatbot ever be a good idea?

This chatbot is never a good idea, but techbros (and you can sometimes read them on HN) think medicine is simple and that we could have AI triage in front of human healthcare professionals.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#103

Post by Triv888 »

EVa5I7bHFq9mnYK wrote: post #90

I don't see many useful applications of GPT-3. I'm sure 90% of its applications will be spam, fake reviews, SEO, fake news and everything fake in general..

Reddit was started with fake content and fake users, I think.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#104

Post by Mengkudulangsat »

colanderman wrote: post #78
Mengkudulangsat wrote: post #70

Earlier quoted context omitted.

Both B) and C) is because these small businesses, most of them have no website. The barrier to entry for businesses to go online from a resource perspective (time, training, cost etc.) is much, much lower to just have a Whatsapp business account. Whatsapp is just an amazing bang-for-your-buck proposition, but we are limited to the constraint of that ecosystem.

If a small business can pay someone else to develop and host a turnkey WhatsApp bot, they can pay someone else to develop and host a turnkey website, no?

It's not meant to be specific to the business. People usually contact small businesses for scheduling / rescheduling / cancellations , those kinds of inquiries are "bot-able" to certain extend. The plan is to have an affordable subsription service for general use.

As I mention before, the decision tree is still designed by the business, the AI is for the natural language processing.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#105

Post by siltpotato »

notahacker wrote: post #21
ComputerGuru wrote: post #13

Earlier quoted context omitted.

I mean, the headline is sensationalized but it’s not so off the mark. It’s not much better with the context.

Yeah. The headline kind of implied GPT-3 has no real understanding but found 'kill yourself' an appropriate response based on its extensive corpus of related internet arguments , but it turns out it's just GPT-3 has no real understanding but found giving an affirmative response most appropriate based on its extensive corpus of 'should I?' questions. And fortunately, it turns out the chatbot is just a research project…

On that note, if I ask "should I" questions, I make a point of asking people who will say "no."

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#106

Post by siltpotato »

1f60c wrote: post #96

In this case, thankfully, the patient was "fake". But let's pretend for a moment that a "mental health chat bot" really did tell an actual patient to kill themselves, and they did. Who would be responsible? It would be criminally negligent, of course , but it feels like something worse, much worse. The only word I can think of is torture.

What's the legal precedent for safety critical systems?

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#107

Post by lanternfish »

Avalaxy wrote: post #12

I'm sorry but why would you ecen use GPT-X for a chatbot? It's open-ended and only gives answers that are statistically likely; not answers that are actually true because it has no real understanding of meaning. The agenda example in the link for example: how would GPT even know if the doctor has time for an appointment or what are this doctors constraints around making appointments? It doesnt.

You could seed the prompt with relevant metadata to offer some basic state; I got this kind of working with a toy chatbot to extend it's memory. It's still a remarkably poor application of the technology though.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#108

Post by AnIdiotOnTheNet »

xiphias2 wrote: post #84
AnIdiotOnTheNet wrote: post #61

Earlier quoted context omitted.

For anyone curious, this variant of chess where both players are trying to lose is simply called "anti-chess" and many chess programs have an anti-chess mode. Playing it is really weird.

I looked it up, but that’s the known variant where the opponent has to take your pieces. Playing to lose a normal chess is uncomparably harder.

Yes, good point. I'd forgotten that capturing was compulsory in anti-chess.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#109

Post by colanderman »

Mengkudulangsat wrote: post #104
colanderman wrote: post #78

Earlier quoted context omitted.

If a small business can pay someone else to develop and host a turnkey WhatsApp bot, they can pay someone else to develop and host a turnkey website, no?

It's not meant to be specific to the business. People usually contact small businesses for scheduling / rescheduling / cancellations , those kinds of inquiries are "bot-able" to certain extend. The plan is to have an affordable subsription service for general use. As I mention before, the decision tree is still designed by the business, the AI is for the natural language processing.

I'm not following. Why can't that service be a web site? That doesn't imply it has to be specific to the business. Think PayPal or Square.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#110

Post by colanderman »

177tcca wrote: post #82
colanderman wrote: post #78

Earlier quoted context omitted.

If a small business can pay someone else to develop and host a turnkey WhatsApp bot, they can pay someone else to develop and host a turnkey website, no?

But...what if they don't know how? Hiring for things you don't know how to do, or why you would, is very difficult.

Why does that make paying for a natural language bot better? Small business owners don't know how to implement natural language AIs any more than they know how to make a web site.

People hire others to do things they don't understand all the time. That's the point of hiring people. You ask your peers for a recommendation and judge based on the result.

Post reply on HN