Live data from Hacker News

A neurology ICU nurse on AI in hospitals

codastory.com

1–10 of 145 posts

Re: A neurology ICU nurse on AI in hospitals

#2
"We didn’t call it AI at first." Because the first things described in the article are not AI. They are ML at most.

Then the article discusses a patient needs scoring method, moving from their own Low/Medium/High model to a scoring method on an unbound linear scale. The author appears to struggle with being able to tell if 240 is high or not. They don't state if they ever had training or saw documentation for the scoring method. Seems odd to not have these things but that if they did the scores would be a lot easier to interpret.

Then they finally get to AI, and it's a pilot scheme for writing patient notes. That's all. If it sucks and hallucinates information it's not going to go live anywhere. No matter how many tech bros try to force it through. If the feedback model for the pilot is bad then the author should take issue with that. It's important that such tests give testers an adequate method to flag issues.

Very much an AI = bad article. AI converging with medical technology is a really dangerous space, for obvious reasons. An article like this does make me worry it's being rushed through, but not because of the author's objections, instead because of their ignorance of what is and what isn't AI, and then on the other side of the apparent lack of consultation being offered by the technology providers even during testing stages.

Re: A neurology ICU nurse on AI in hospitals

#3
post #2

"We didn’t call it AI at first." Because the first things described in the article are not AI. They are ML at most. Then the article discusses a patient needs scoring method, moving from their own Low/Medium/High model to a scoring method on an unbound linear scale. The author appears to struggle with being able to tell if 240 is high or not. They don't state if they ever had training or saw documentation for the sco…

> AI converging with medical technology is a really dangerous space, for obvious reasons. An article like this does make me worry it's being rushed through, but not because of the author's objections, instead because of their ignorance of what is and what isn't AI

I mean, worth pointing out that OpenAI has been shoving LLMs into people's faces for going on about a year and half now at global scale and calling it AI, to a degree that now we have to call AI AGI, and LLM's get called AI, even though there is nothing intelligent about them whatsoever.

Just saying when the marketing for a tech is grinding the edge of being misinformation itself, it's pretty normal for the end users to end up pretty goddamn confused by the end.

Re: A neurology ICU nurse on AI in hospitals

#4
post #2

"We didn’t call it AI at first." Because the first things described in the article are not AI. They are ML at most. Then the article discusses a patient needs scoring method, moving from their own Low/Medium/High model to a scoring method on an unbound linear scale. The author appears to struggle with being able to tell if 240 is high or not. They don't state if they ever had training or saw documentation for the sco…

The industry calls AI even the dumbest linear system, I don't think it is right to blame non industry people if they don't use the right words after that.

Re: A neurology ICU nurse on AI in hospitals

#5
Healthcare is a massive cost for people, businesses, and governments.

>So we basically just become operators of the machines.

Driving down the cost of manufacturing because of process standardization and automation brought down the cost of consumer goods, and labor's value.

If you don't think this is coming for every single area of business, you're foolish. Driving down labor costs is the golden goose. We've been able to collect some eggs through technology, but AI and the like will be able to cut that goose open and take all the eggs.

Re: A neurology ICU nurse on AI in hospitals

#6
post #2

"We didn’t call it AI at first." Because the first things described in the article are not AI. They are ML at most. Then the article discusses a patient needs scoring method, moving from their own Low/Medium/High model to a scoring method on an unbound linear scale. The author appears to struggle with being able to tell if 240 is high or not. They don't state if they ever had training or saw documentation for the sco…

> No matter how many tech bros try to force it through.

Are you sure about that? My wife is a nurse and she has to deal with multiple machines that were put in her unit just because the hospital has a contract with XYZ brand. It doesn't matter at all if these machines are 5x more expensive, x10 slower, x80 less effective, etc... compared with the "other" machines (from other brands).

I'm actually terrified the same might happen with this.

Re: A neurology ICU nurse on AI in hospitals

#7
post #2

"We didn’t call it AI at first." Because the first things described in the article are not AI. They are ML at most. Then the article discusses a patient needs scoring method, moving from their own Low/Medium/High model to a scoring method on an unbound linear scale. The author appears to struggle with being able to tell if 240 is high or not. They don't state if they ever had training or saw documentation for the sco…

I think the effort to keep the definition of AI narrow is not useful (and futile, besides). By both common usage and even most formal definitions, it's an umbrella term, and sometimes refers to a specific thing under that umbrella that we already have other words for if we would like to be more specific (ML, deep learning, LLM, GPT, genAI, neural net, etc).

Re: A neurology ICU nurse on AI in hospitals

#8
post #5

Healthcare is a massive cost for people, businesses, and governments. >So we basically just become operators of the machines. Driving down the cost of manufacturing because of process standardization and automation brought down the cost of consumer goods, and labor's value. If you don't think this is coming for every single area of business, you're foolish. Driving down labor costs is the golden goose. We've been abl…

> will be able to cut that goose open and take all the eggs

You're completely right! AI will kill the golden goose, that is what this metaphor is all about.

Re: A neurology ICU nurse on AI in hospitals

#9
post #2

"We didn’t call it AI at first." Because the first things described in the article are not AI. They are ML at most. Then the article discusses a patient needs scoring method, moving from their own Low/Medium/High model to a scoring method on an unbound linear scale. The author appears to struggle with being able to tell if 240 is high or not. They don't state if they ever had training or saw documentation for the sco…

> If it sucks and hallucinates information it's not going to go live anywhere.

It hallucinates and it's live in many places. My doctor uses it.

AFAICT the hallucination rate is fairly low. It's transcription and summarization which has a lower hallucination rate than when it's asked for an answer.

It's massively better than the alternative. Taking the time to write down proper notes is the difference between 4 patients per hour and 6 and a commensurate drop in income. So notes virtually always get short-changed.

Very occasionally hallucinated notes are better than notes that are almost always incomplete.

Re: A neurology ICU nurse on AI in hospitals

#10
Everyone should be terrified. The "promise" of AI is the following: remove any kind of remaining communication between humans, because that is "inefficient", and replace it with an AI that will mediate all human interactions (in business and even in other areas). In a few years, AIs trained by big corps will run the show and humans will be required to interface with them to do anything of value. Similar to what they want to do nowadays with mobile/enterprise systems, but at a much deeper level.
Post reply on HN