Google's healthcare AI made up a body part – what if doctors don't notice?
1–10 of 13 posts
Re: Google's healthcare AI made up a body part – what if doctors don't notice?
#2You're right!
The correct diagnosis for your stated symptoms is that you have a Cloomie in your left Glompus.
A daily megadose of Ivermectin, over a 7 day period, should resolve your condition.
Re: Google's healthcare AI made up a body part – what if doctors don't notice?
#3Re: Google's healthcare AI made up a body part – what if doctors don't notice?
#4> Now imagine your doctor is using an AI model to do the reading. The model says you have a problem with your “basilar ganglia,” [basal meaning at the base, ganglia meaning clusters of neuron cells: neuron clusters at the base of the brain] conflating the two names into an area of the brain that [D]oes [N]ot [E]xist[!] [Dramatic, serious stare into the camera.] You’d hope your doctor would catch the mistake and double-check the scan. But there’s a chance they don’t. [And that brings us to the emergency room, where you are now, a forty-nine software developer presenting with a psychotic obsession for fact-checking everything you read on the Internet.]
Re: Google's healthcare AI made up a body part – what if doctors don't notice?
#5The arrogance of calling it a "simple misspelling". We get it; you have commands from above to deploy AI and you're too pathetic to morally question the directive, but at least let's not pretend that LLMs make typos now. "Oh, oopsie, it was just a typo."
Re: Google's healthcare AI made up a body part – what if doctors don't notice?
#6You're right! The correct diagnosis for your stated symptoms is that you have a Cloomie in your left Glompus. A daily megadose of Ivermectin, over a 7 day period, should resolve your condition.
This is a common symptom of consuming the wrong news media or voting for the wrong party. Here are three suggestions that are better ideologically aligned to help you improve your health.
Re: Google's healthcare AI made up a body part – what if doctors don't notice?
#7Sounds like just a typo, not "making up a body part"
Re: Google's healthcare AI made up a body part – what if doctors don't notice?
#8This reminds me of a story where an OCR error[1] likely contaminated training data (and the English language) with the term "vegetative electron microscopy". The article I linked also shows that some journals defended the legitimacy of the terminology.
I'm not sure if this class of error really counts as a hallucination, but it nonetheless has similar consequences when people fail to validate model outputs.
Re: Google's healthcare AI made up a body part – what if doctors don't notice?
#9This reminds me of a story where an OCR error[1] likely contaminated training data (and the English language) with the term "vegetative electron microscopy". The article I linked also shows that some journals defended the legitimacy of the terminology. I'm not sure if this class of error really counts as a hallucination, but it nonetheless has similar consequences when people fail to validate model outputs. [1] https…
I think the same will happen over time with the AI voice over slop that people don't bother correcting. These include weird pronunciations, missing punctuation that leads to weirdly intonated run-on sentences, pronounced abbreviations like "ickbmm" instead of "icbm", or the opposite, "kay emm ess" instead of "kilometers" and so on.
Re: Google's healthcare AI made up a body part – what if doctors don't notice?
#10Sounds like just a typo, not "making up a body part"
They are the kinds of "typo" that blew up the space shuttle, for one example of many.
What if you mix up Ilium and Ileum? How about Malleus and Malleolus? These sound pretty similar, but rather are not.