51–60 of 63 posts
This is a blatant violation of patient privacy. That the output is often hallucinated doesn't even matter here. If the hospital wants to use LLMs, better deploy them on-premise or a trusted network at least.
Enterprises are ok sharing their code base with OpenAI. I think it should be okay for patients.
Earlier quoted context omitted.
Very little protections. The entire medical records of a significant percentage of the NZ population were stolen recently and put up for sale online. Zero consequences for the medical practices who adopted the hacked software.
Interesting, a person was telling me recently that NZ privacy laws were quite strong. Perhaps a different category. https://news.ycombinator.com/item?id=44564349
This is a blatant violation of patient privacy. That the output is often hallucinated doesn't even matter here. If the hospital wants to use LLMs, better deploy them on-premise or a trusted network at least.
Noticing that people in the west would rather speak about privacy than more efficient or cheaper healthcare. Enterprises are ok sharing their code base with OpenAI. I think it should be okay for patients.
Earlier quoted context omitted.
Physicians need to have it pounded into them that every hallucination is downstream harm. AI has no place in medicine. If they insist on it, then all transcripts must be stored with the raw audio. Which should be accessible side by side, with lines of transcript time coded. It's the only way to actually use these safely, while guarding against hallucinations.
> Physicians need to have it pounded into them that every hallucination is downstream harm. I think any person using 'AI' knows it makes mistakes. In a medical note, there are often errors at present . A consumer of a medical note has to decide what makes sense and what to ignore, and AI isn't meaningfully changing that. If something matters, it's asked again in follow up.
You think wrong. I’m now encountering people on a regular basis arguing “those days are behind us” and it’s “old news.”
This is a blatant violation of patient privacy. That the output is often hallucinated doesn't even matter here. If the hospital wants to use LLMs, better deploy them on-premise or a trusted network at least.
Noticing that people in the west would rather speak about privacy than more efficient or cheaper healthcare. Enterprises are ok sharing their code base with OpenAI. I think it should be okay for patients.
In the email I wrote out everything myself, absolutely no use of AI, but after I hit send I realised there was a pretty silly typo, nothing grave but it irked me.
I decided out of boredom to see would my email be considered AI as it was probably going to go through a million filters these days, I popped it into an online checker (I don't know the quality of these so who knows) and it told me with 75% certainty it was written by AI.
It was not at all. It was written overly hastily on a phone on public transport. So I wonder how someone who might be grammar orientated and particular with the semantics would prove otherwise.
I can see a company needing to find any excuse to let people go saying "well theAI says you used the AI to do your work, we're letting you go"
AI doesn't forget and soon all of new zealanders will have their health histories internalised by AI so it can individually calculate insurance premiums without knowing why....
This is a ridiculous sentence. Of course inference-only AI forgets. You can literally just program it that way. In fact, it's human transcribers who chose whether to forget the details of a case or whether to share the details of an especially funny patient with their buddies at the bar.
Earlier quoted context omitted.
This is a ridiculous sentence. Of course inference-only AI forgets. You can literally just program it that way. In fact, it's human transcribers who chose whether to forget the details of a case or whether to share the details of an especially funny patient with their buddies at the bar.
But in this case they’re actively being told by the hospital not to use AI due to privacy concerns so it seems unlikely that it’s been programmed to respect privacy doesn’t it
You can program a harness to always send a MEMORY.md file like OpenClaw, or use Vector Stores like OpenAI does, or find some other implementation of 'memory', but these are not an inherent feature of 'AI'. Quite the opposite...the LLMs we currently see will never learn or adapt by themselves, they don't touch their own weights
Yeah, no privacy or security there. There are some tools explicitly designed at helping healthcare providers produce better notes faster, and a couple of them are AMAZING. I'm an AI-half-empty guy, I'm keenly aware of its shortcomings and deploy it thoughtfully, and even with my skepticism there are a couple of tools that are just plain great. I think using LLMs to create overviews and summaries is a great use of the…
The one my doctor was using got my obs numbers completely wrong. We had to correct them at the end of the consultation.