Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

artificialintelligence-news.com

Post reply on HN
Print view View original

111–120 of 122 posts

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#111

Post by colanderman »

visarga wrote: post #83
colanderman wrote: post #55

Earlier quoted context omitted.

> am-I the only one that thinks this whole "chat bot having a natural conversation to book an appointment" is useless when a simple date-picker would do? Nope. I find being forced to converse in English with a machine to be absolutely infuriating. I know what I want and how to tell it to a machine. Being forced to add noise words to allow my request to pass through a useless extra layer is a disrespectful waste of my…

> I know what I want and how to tell it to a machine. Yeah, Google search is not that great when you want to do conditional search in a topic with many false positives. For example I want to find a light electric scooter, under 10Kg of weight. Google will happily report all the pages that contain scooter and kg, but the kg would be for the max weight of the person, not the scooter itself. How do I tell it that in key…

Actually I feel like Google is the one such service that is approaching natural language usability for general topic queries. It seems to me to be able to extract basic meaning from simple English phrases and search that sentiment. Whereas search phrases containing negatives ("not", "isn't") used to be futile, Google now correctly infers your meaning.

But yes, for parametric search I think I would always prefer a direct interface. It makes clear what is indexed and what isn't.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#112

Post by zigzaggy »

tzs wrote: post #28
908B64B197 wrote: post #3

I recall an AI playing a game that, just before losing, would press the "menu" button to pause the game and then stop doing anything. It fulfilled it's goal (not lose). That behavior should set expectations when it comes to AI. Also, am-I the only one that thinks this whole "chat bot having a natural conversation to book an appointment" is useless when a simple date-picker would do?

Another fun one is when the programmers accidentally give the AI the wrong goal. I have no idea if this actually happened, but I've heard of a chess program that was playing in a tournament that started making really weird moves in the endgame. Before that point, it was playing excellently. It took the developers a while to figure out what was going on. They had made a mistake when doing some last minute tweaks befor…

This reminds me of the first time I took LSD. I ended up at a hippy coffee shop with a Canadian soccer player (also tripping) playing a game of chess with the goal of losing.

It’s hard to play to lose! We ended up having a long conversation with a bearded man who kept telling us he’d been where we were.

Of that I have no doubt.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#113

Post by Isomatik »

Lorin wrote: post #99
908B64B197 wrote: post #3

I recall an AI playing a game that, just before losing, would press the "menu" button to pause the game and then stop doing anything. It fulfilled it's goal (not lose). That behavior should set expectations when it comes to AI. Also, am-I the only one that thinks this whole "chat bot having a natural conversation to book an appointment" is useless when a simple date-picker would do?

Reminds me of an old (~8yr?) article about applying machine learning to hardware - and one of the tests was producing a chipset that could produce a certain output tone. ... it worked, but only in a specific area of the lab. When they looked at the layout, they discovered the ML system designed a circuit that picked up relevant nearby EM/radio noise as the source, so when the chip was moved - it broke. It produced a…

This looks like the original paper: https://www.researchgate.net/publication/2737441_An_Evolved_...

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#115

Post by UncleMeat »

908B64B197 wrote: post #3

I recall an AI playing a game that, just before losing, would press the "menu" button to pause the game and then stop doing anything. It fulfilled it's goal (not lose). That behavior should set expectations when it comes to AI. Also, am-I the only one that thinks this whole "chat bot having a natural conversation to book an appointment" is useless when a simple date-picker would do?

It is very important to know two things about that work.

1. It was for Sigbovik, which is a joke conference. The work was a fun side project by one dude.

2. Tom Murphy isn't an AI researcher, it wasn't intended to demonstrate the state of the art of the field, and it wasn't using modern techniques like neural networks.

It was a great story and I love Tom's work, but it shouldn't be used as a meaningful example of the limitations or worries regarding AI.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#116

Post by UncleMeat »

etrain wrote: post #68
fartcannon wrote: post #66

Earlier quoted context omitted.

There was an AI created the absolutely brilliant Tom7 on on his YouTube channel 'SuckerPinch' on April 1, 2013 that paused a game of Tetris instead of losing. In my opinion, Tom doesn't get enough credit for his work. He released his AI a full 8+ months before DeepMind released their Atari playing AI. Watch the whole thing, it's delightful. The AI pauses Tetris right before it loses at around 16mins into the video. h…

Tom7’s sigbovik submissions are true works of art. https://www.cs.cmu.edu/~tom7/mario/mario.pdf

My personal favorite is the compiler that uses only the printable bytes.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#117

Post by UncleMeat »

EVa5I7bHFq9mnYK wrote: post #90

I don't see many useful applications of GPT-3. I'm sure 90% of its applications will be spam, fake reviews, SEO, fake news and everything fake in general..

I think seeding creativity is rather interesting. Tom Scott's recent video on using GPT-3 to come up with ideas for new videos is a great example.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#118

Post by joe_the_user »

peterwoerner wrote: post #67
joe_the_user wrote: post #57

Earlier quoted context omitted.

If you say OpenAI will only approve applications for "zero stakes", domains, then you are saying what the parent is saying - it's entirely for entertainment. If you claim there's some "low but not zero" stakes application, I'd like to know what that is. I mean, it seems clear that if someone asks a GTP-3 customer service bot "so what should I do now", there's a reasonable probability that the bot would say "throw you…

I would saw that copy.ai is a low but not zero stakes application. It develops a draft of copy for ads, landing pages etc. which you can review before taking live.

Sure, I can see "low stakes plus human review" sounds doable but not that much a evolute from "no stakes".

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#119

Post by perl4ever »

otabdeveloper4 wrote: post #95
exporectomy wrote: post #72

Earlier quoted context omitted.

Regarding 2. That's what doctor's receptionists do all day. They must be doing it for some reason. I guess old people don't like annoying web forms? I'm old and I don't. For example, I've formed a habit of opening terms and conditions links in another tab because I've experienced forms that clear your data when you click them directly then try to to "back" afterwards. But just a few weeks ago, I did that and when I r…

Web forms work spectacularly well when you stick to, well, actual web HTML form elements. The problem is frontend developers reinventing their own widgets and protocols because "moronic SPA reasons".

One little thing that aggravates me is that you can't type a sequence of letters and have a drop down menu go to the appropriate choice most of the time.

Like, I can type "N" and it will select the first choice beginning with "N", but I can't type "New" and go to the first one beginning with "New".

This functionality was standard on the Macintosh maybe 30+ years ago, but I feel like 80% of the time on the web, it isn't.

Re: Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves

#120

Post by hprotagonist »

drdeca wrote: post #31
hprotagonist wrote: post #6

CICO: chan in, chan out. transformers don’t do anything novel, in the sense that literally all they can do is sample their training data in some optimal way. Don’t ask GPT3 if you should be an hero...

What do you mean by "sample their training data"? It gives a probability distribution over possible values for the next token, in a way that was trained to do well on the training data, yes. But, something which gives a uniform distribution over characters, has a nonzero (though of course minuscule and entirely negligible) chance of giving any given sequence of characters, and so if there is any text which would be "…

https://faculty.washington.edu/ebender/papers/Stochastic_Par...

> As we discuss in §5, LMs are not performing natural language understanding (NLU), and only have success in tasks that can be approached by manipulating linguis- tic form [14].

Post reply on HN