Live data from Hacker News

I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

inflecthealth.medium.com

101–110 of 368 posts

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#101

I asked ChatGPT to write out a G major Ionian scale with three notes per string in guitar tablature notation last night. Mostly cause I was too lazy to do it myself. After 7 rounds of me fixing its mistakes, I gave up. It doesn’t really know what it is doing, so I can’t make forward progress. It put two notes on one string, repeated notes from a lower string on a higher, put the scale out of order, and forget previou…

I don't know how much this sort of thing is frowned upon here, but I wrote an article about this scenario recently. http://paritybits.me/disposable

tldr: the gpt services will eventually (maybe soon) recognize opportunities to write and run their own bespoke software to provide higher resolution outputs.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#103
post #48

I know everyone scoffs at the concept of 'prompt engineer', but it really is an essential craft that we're going to have to come to terms with when interacting with large language models. Seeking suggestions on a more comprehensive prompt: https://sharegpt.com/c/sckAPvV Trying it out: https://sharegpt.com/c/LbpEIxi

I don’t scoff at it, but I do think it’s kinda funny. It’s essentially the same skill as being a “google search expert” in the sense that you need to be able to correctly understand the problem, and craft a good enough query to generate the answer you’re looking for. It’s always sort of been a tongue-in-cheek claim that googling skills are a valuable software engineering asset, and even though that’s a perfectly legitimate assertion, it’s entertaining to see it emerging at its own “engineering” discipline.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#104

> about 8% of pregnancies discovered in the ER are of women who report that they’re not sexually active. This is the most surprising thing I read in the article.

As woman this doesn't surprise me at all. There is a lot of circumstances where a woman would not want to admit to an ER that they are sexually active; Religion, the sex was non consensual, they are with someone who doesn't know they are sexually active.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#105

Earlier quoted context omitted.

It is very nearly the opposite to a calculator. A calculator gives you exact results for a very small subset of problems (equations). Chat-GPT will give you approximate (and occasionally incorrect) solutions to an extremely wide range of problems. The main problem with AI is that there are only so many problems where an approximate solution is fine, and an incorrect solution is easy to work around. In order for AI to…

Disagree. For AI to be useful it needs to be better at the job than how the job currently being done. We humans rely on thousands of things where an approximate solution is fine. Especially when it's about interacting with other humans. Programming is an exception, but what % of the population are programmers and engineers?

Programmers, engineers, accountants, lawyers, doctors, nurses, builders, farmers, manufacturers, drivers (including pilots and ships captains), and scientists all need to be very precise in their work and mistakes will cause deaths (I have almost certainly forgotten some). This may not be the majority of workers by number, but these are the jobs civilization is _built_ on, they are the jobs that need to keep going no matter what or the whole house of cards collapses.

The majority of jobs that require less precision falls under the umbrella of artists (I will include advertisers here), people managers, and service workers.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#106

I asked ChatGPT to write out a G major Ionian scale with three notes per string in guitar tablature notation last night. Mostly cause I was too lazy to do it myself. After 7 rounds of me fixing its mistakes, I gave up. It doesn’t really know what it is doing, so I can’t make forward progress. It put two notes on one string, repeated notes from a lower string on a higher, put the scale out of order, and forget previou…

I have one specific task where GPT-3.5 failed completely, but GPT-4 succeeded spectacularly (generating correctly formatted AutoRig Pro bone mappings in Blender from one armature to another).

4 still fails regularly on a lot on seemingly basic tasks, but it is a noticeable step up from 3.5. As they continue to scale it up, I suggest checking back in every few months to see if the newer versions perform any better.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#108
post #90

I'm not really sure what he expected here, ChatGPT was not trained to be a doctor, it is far more general than that. Asking ChatGPT for medical advice is like asking someone who is very well read but has no experience as a doctor, and in that context it's doing very well. He also brings up one of the most salient points without really visiting it enough: ChatGPT does not ask for clarification, because it is not a kno…

"I'm not really sure what he expected here, ChatGPT ..." Doctoring is quite similar to ITing if you are careful with your similes. In medicals you look for indications and contraindications. In IT you look for magic beans and sometimes look at logfiles. I have no idea why we (IT) don't follow the medical way and have indications and contras (I do). They have been doing complicated diagnostics way longer than we have.…

There was an old USENIX symposium where one of the talks was, "If computers had blood, they'd call us doctors." My thought at the time was, "If computers had blood, they'd call us serial killers."

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#109
post #76

Earlier quoted context omitted.

What I didn't predict is so many AI boosters being so miffed at regular folks pointing out the obvious: a half-working system may be tremendously exciting to AI enthusiasts, but it's not that useful to society. Recently we've had all these people complaining of moving goalposts, when in fact most people never had goalposts for AI in the first place, and certainly never had goalposts that remotely resembled those that…

It's a bloody calculator and a damn good one (but it can and does go mad). Use it like that and you'll be fine. Have you actually engaged with it in any way? Its free to sign up. By the way, what on earth is an AI booster? Do you really mean "enthusiast"? "My mental model seems to clash with that of the boosters." Please tell us about your mental model, we can't read your mind.

"Booster" can also now mean technologists who have correctly predicted the number and size of executive erections once teased with the idea of automating most of their office. Put on something black and tight, go up on stage and twirl around that notion until balled-up Jacksons grease the creaking floorboards. You know you'll be riding in a Cayenne tonight. Maybe a Boxster.

It actually sounds pretty familiar for those of us in the side shows for other Miracle Technologies That'll Fix Your Business, but it's a hell of a lot easier to set up a convincing model than something like SAP. Also, unlike ERP, GPT is a real thing, and it does real stuff, so that will make it easier to take the money. Real science is happening, which is always more fun, even if Homo Executivus uses it as a marital aid. I guess this makes me a Booster, but one of those old wrinkled Boosters who sounds like a carton of Newports.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#110

Being a scifi geek and AI geek and neuroscience geek for pretty much the past 40 years, I've read countless predictions and scenarios and stories about society's response as "true" AI begins to emerge. So watching it play out for real is creating this bizarre sense of deja vu combined with fascination and frustration and also some anxiety. This article and the comments in this thread are right up that alley. I mean,…

What I didn't predict is so many AI boosters being so miffed at regular folks pointing out the obvious: a half-working system may be tremendously exciting to AI enthusiasts, but it's not that useful to society. Recently we've had all these people complaining of moving goalposts, when in fact most people never had goalposts for AI in the first place, and certainly never had goalposts that remotely resembled those that…

> a half-working system may be tremendously exciting to AI enthusiasts, but it's not that useful to society.

A half-working system might actually be worse than useless if people believe it 100% of the time.

Post reply on HN