Live data from Hacker News

Large Language Models Are Few-Shot Health Learners

arxiv.org

1–10 of 48 posts

Re: Large Language Models Are Few-Shot Health Learners

#3
I find the healthcare applications of this stuff so interesting.

On the one hand, there are SO many reasons using LLMs to help people make health decisions should be an utterly terrible idea, to the point of immorality:

- They hallucinate

- They can't do mathematical calculations

- They're incredibly good at being convincing, no matter what junk they are outputting

And yet, despite being very aware of these limitations, I've already found myself using them for medical advice (for pets so far, not yet for humans). And the advice I got seemed useful, and helped kick off additional research and useful conversations with veterinary staff.

Plenty of people have very limited access to useful medical advice.

There are plenty of medical topics which people find embarrassing, and would prefer to - at least initially - talk to a chatbot than to their own doctor.

Do the benefits outweight the risks? As with pretty much every ethical question involving LLMs, there are no obviously correct answers here.

Re: Large Language Models Are Few-Shot Health Learners

#4
post #3

I find the healthcare applications of this stuff so interesting. On the one hand, there are SO many reasons using LLMs to help people make health decisions should be an utterly terrible idea, to the point of immorality: - They hallucinate - They can't do mathematical calculations - They're incredibly good at being convincing, no matter what junk they are outputting And yet, despite being very aware of these limitatio…

> found myself using them for medical advice (for pets so far, not yet for humans)

Which model did you use?

Re: Large Language Models Are Few-Shot Health Learners

#5
post #3

I find the healthcare applications of this stuff so interesting. On the one hand, there are SO many reasons using LLMs to help people make health decisions should be an utterly terrible idea, to the point of immorality: - They hallucinate - They can't do mathematical calculations - They're incredibly good at being convincing, no matter what junk they are outputting And yet, despite being very aware of these limitatio…

I agree, Ive found combining LLMs with Google has worked well for research. Use it for all sorts if random things, usually starting with search then hopping to chatgpt or bard when I cant understand the results. Then back to search when I know what to look for again.

Re: Large Language Models Are Few-Shot Health Learners

#6
It seems that time and time again, transformers are the swiss army knife of learning systems. And specifically LLMs are proving to be like chameleons. In some ways that shouldn't be surprising. Some say that math is a universal language after all, and we seem to agree that math is unreasonably effective at describing reality.

Re: Large Language Models Are Few-Shot Health Learners

#7
post #3

I find the healthcare applications of this stuff so interesting. On the one hand, there are SO many reasons using LLMs to help people make health decisions should be an utterly terrible idea, to the point of immorality: - They hallucinate - They can't do mathematical calculations - They're incredibly good at being convincing, no matter what junk they are outputting And yet, despite being very aware of these limitatio…

I have been saying this for months for deep learning in general (and now the new hype in LLMs) in high risk situations such as medical, legal and financial advice and even transportation. The only common use-case which makes sense is summarization and even then, a human expert ends up reviewing the output before post it anyway.

> There are plenty of medical topics which people find embarrassing, and would prefer to - at least initially - talk to a chatbot than to their own doctor.

I don't think you would trust an AI chatbot alone to take a number of pills for any medication instead of going to a human doctor, especially when these AI models risk hallucinating terrible advice and its output is unexplainable and as transparent as a black-box. The same goes for 'full self-driving'.

I don't think one would trust these deep learning-based AI systems in very high risk situations unless they are highly transparent and can thoroughly explain themselves rather than regurgitate back what it has been trained on already.

It is like trusting a AI to pilot a Boeing 737 Max with zero human pilots on board end-to-end. No one would board a plane that has an black-box AI piloting it. (Autopilot is not the same thing)

Re: Large Language Models Are Few-Shot Health Learners

#8
I find chat GPT to be very helpful for working with programming languages that I’m less comfortable using (shell, python). I know enough to evaluate correct code in these languages, but producing it from scratch is more difficult, which seems like a sweet spot for carefully using ChatGPT for code.

As a physician, I would not be surprised if the medical use of these tools ends up having similar value.

Re: Large Language Models Are Few-Shot Health Learners

#9
post #3

I find the healthcare applications of this stuff so interesting. On the one hand, there are SO many reasons using LLMs to help people make health decisions should be an utterly terrible idea, to the point of immorality: - They hallucinate - They can't do mathematical calculations - They're incredibly good at being convincing, no matter what junk they are outputting And yet, despite being very aware of these limitatio…

I'd be happy with summarizing and aggregating of health and longevity articles/papers to have a concise digest of strategies.

Case in point, I'm a big fan of Andrew Huberman (https://www.youtube.com/@hubermanlab). He's quite prolific and his presentations pack a lot of data. Just taking all of that in would require a lot of time. Being able to have it condensed and indexed would be wonderful.

Plenty of others like him (e.g., Rhonda Patrick, Peter Attia, etc.) High quality stuff but there's literally not enough time to take all of it in.

Re: Large Language Models Are Few-Shot Health Learners

#10
post #3

I find the healthcare applications of this stuff so interesting. On the one hand, there are SO many reasons using LLMs to help people make health decisions should be an utterly terrible idea, to the point of immorality: - They hallucinate - They can't do mathematical calculations - They're incredibly good at being convincing, no matter what junk they are outputting And yet, despite being very aware of these limitatio…

Whatever else its ills, the bot actually will pay attention to the tokens you're submitting to it to formulate its answer. That puts it well ahead of a majority of the doctors I've seen over the years.

I say this without snark- it is simply true. I should also mention that a good quarter of the medical care folks who have assisted me have gone above and beyond in exceptional ways. It is a field of extremes.

Post reply on HN