Live data from Hacker News

Google Med-Palm M: Towards Generalist Biomedical AI

arxiv.org

51–60 of 101 posts

Re: Google Med-Palm M: Towards Generalist Biomedical AI

#51

I've posted this story before, but AI has diagnosed a problem patient in our clinic, (and now has diagnosed a second problem patient). Basically no one could figure out what was wrong with the patient despite 2 years of seeing GP + Specialist + strong drugs. In about 5 minutes GPT3 gave my wife 10 possible diagnosis, she looked up the ones she wasnt familiar with, found one she thought matched, and later did the conf…

I assume you and your wife are not in the US. Stateside, you would need a Business Associate Agreement to send protected health information to a third party.

Re: Google Med-Palm M: Towards Generalist Biomedical AI

#53

Having spent some time with a hallucinating ChatGPT and having spent some time with doctors during my life, at this point, in my humble opinion, it should be made illegal for a doctor to make a diagnosis without consulting an LLM finetuned with all the medical research and literature available. Ah, but copyright/patents/IP. Well, IP was created to foster production of useful immaterial stuff. If you now want to use i…

> it should be made illegal for a doctor to make a diagnosis without consulting an LLM

> All liability stays at the doctor who makes the final diagnosis

Sorry, what? You’d force clinicians to use a specific technology (a specific “how” for finding their answer) and also make them liable for the correctness of that answer?

You seem to have a strange idea about the law if in the same breath as you make something illegal, you sigh with exasperation at lawyers and liability.

Re: Google Med-Palm M: Towards Generalist Biomedical AI

#54

Having spent some time with a hallucinating ChatGPT and having spent some time with doctors during my life, at this point, in my humble opinion, it should be made illegal for a doctor to make a diagnosis without consulting an LLM finetuned with all the medical research and literature available. Ah, but copyright/patents/IP. Well, IP was created to foster production of useful immaterial stuff. If you now want to use i…

> it should be made illegal for a doctor to make a diagnosis without consulting an LLM > All liability stays at the doctor who makes the final diagnosis Sorry, what? You’d force clinicians to use a specific technology (a specific “how” for finding their answer) and also make them liable for the correctness of that answer? You seem to have a strange idea about the law if in the same breath as you make something illega…

> Sorry, what?

I did not say the doctor would need to trust the answer. Only that they should be required to ask.

Re: Google Med-Palm M: Towards Generalist Biomedical AI

#55

I've posted this story before, but AI has diagnosed a problem patient in our clinic, (and now has diagnosed a second problem patient). Basically no one could figure out what was wrong with the patient despite 2 years of seeing GP + Specialist + strong drugs. In about 5 minutes GPT3 gave my wife 10 possible diagnosis, she looked up the ones she wasnt familiar with, found one she thought matched, and later did the conf…

I assume you and your wife are not in the US. Stateside, you would need a Business Associate Agreement to send protected health information to a third party.

Not always. It is not necessary to have a BAA to look up diagnosis information using patient data, so long as the data used maintains the patient’s anonymity.

For example, a doctor googling your symptoms doesn’t require a BAA with google.

Re: Google Med-Palm M: Towards Generalist Biomedical AI

#56

Having spent some time with a hallucinating ChatGPT and having spent some time with doctors during my life, at this point, in my humble opinion, it should be made illegal for a doctor to make a diagnosis without consulting an LLM finetuned with all the medical research and literature available. Ah, but copyright/patents/IP. Well, IP was created to foster production of useful immaterial stuff. If you now want to use i…

> it should be made illegal for a doctor to make a diagnosis without consulting an LLM > All liability stays at the doctor who makes the final diagnosis Sorry, what? You’d force clinicians to use a specific technology (a specific “how” for finding their answer) and also make them liable for the correctness of that answer? You seem to have a strange idea about the law if in the same breath as you make something illega…

Peak SV techbro moment.

Re: Google Med-Palm M: Towards Generalist Biomedical AI

#57

Model performance doesn't seem to be monotonically increasing with size. The 84B parameter model is the best on most tasks. What happened to "you just train it on more data and performance goes up exponentially"? There were so many charts proving this and we could even project at what level of data/compute world-conquering superintelligence would inevitably emerge.

Maybe there is simply not enough medical data to properly train a 500B model.

Re: Google Med-Palm M: Towards Generalist Biomedical AI

#58

I've posted this story before, but AI has diagnosed a problem patient in our clinic, (and now has diagnosed a second problem patient). Basically no one could figure out what was wrong with the patient despite 2 years of seeing GP + Specialist + strong drugs. In about 5 minutes GPT3 gave my wife 10 possible diagnosis, she looked up the ones she wasnt familiar with, found one she thought matched, and later did the conf…

If GPT3 was trained on WebMD, 9 out of the 10 would have been a cancer diag.

Re: Google Med-Palm M: Towards Generalist Biomedical AI

#59

I won't take any of this seriously until they make their model and weights available. This type of PR research is what is really holding back AI for medical images.

Also, Google is always and constantly making announcements that Bard or whatever IA tech (Music-LM, etc) is supposedly beating all the competitors, but nobody can use or see such models, only very inferiors ones, curious, right ( ͡° ͜ʖ ͡°) ?

Re: Google Med-Palm M: Towards Generalist Biomedical AI

#60

Model performance doesn't seem to be monotonically increasing with size. The 84B parameter model is the best on most tasks. What happened to "you just train it on more data and performance goes up exponentially"? There were so many charts proving this and we could even project at what level of data/compute world-conquering superintelligence would inevitably emerge.

There is text under the table.
Post reply on HN