MDN can now automatically lie to people seeking technical information

Post by gAI » Sat, Jul 01, 2023, 2:01 PM UTC

rideontime wrote: post #70

gAI wrote: post #69

Earlier quoted context omitted.

I was thinking more about SSRI's, which make up over half ( https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8450889/ ) of US pharmacy orders. While we do know that they work for some people, they only work for 20% of people ( https://www.ncbi.nlm.nih.gov/books/NBK361016/ ). They also come with common side effects that can lower quality of life ( https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2719451/ ). And we do not unde…

Your own links demonstrate the fundamental difference. The side effects have been studied and can be identified. I'm at this very moment taking a break from a medication because I was able to recognize a severe side effect that came up. I can't recognize when an LLM has generated a nonsensical piece of technical documentation; if I could, I wouldn't need to use it in the first place.

Post by rideontime » Sat, Jul 01, 2023, 2:21 PM UTC

gAI wrote: post #71

rideontime wrote: post #70

Earlier quoted context omitted.

Your own links demonstrate the fundamental difference. The side effects have been studied and can be identified. I'm at this very moment taking a break from a medication because I was able to recognize a severe side effect that came up. I can't recognize when an LLM has generated a nonsensical piece of technical documentation; if I could, I wouldn't need to use it in the first place.

The side effects of incompatible code are similar to the side effects of incompatible medication. Thanks to the identified undesirable effects, you usually identify the problem and resolve the issue with other resources. Occasionally the problem is more severe or persists unidentified. We should definitely be working to minimize these effects and prevent them where possible, but that doesn’t mean we stop trying/utili…

Post by rideontime » Sat, Jul 01, 2023, 3:34 PM UTC

gAI wrote: post #74

rideontime wrote: post #73

Earlier quoted context omitted.

- “Incompatible code”? What does this even mean? “Incompatible” with what? - Have you actually read the examples in the linked github issue? What “undesirable effect” are you able to identify when an LLM tells you that a JS function simply doesn’t exist? Or when something fails subtly enough that the code you wrote based on the LLM’s advice isn’t the obvious culprit? Do you do much debugging? - Wikipedia requires ref…

If a medication is incompatible with a person's specific biology, they don’t see improvement (or their health declines). If a function is described incorrectly, you won’t see improved functionality (or you’ll see bugs). It was incompatible with the syntax/compiler/the rest of the code. Though this one won't, LLMs will cite references if asked. They’ll also provide step-by-step rationalization (though they don’t think…

Post by [deleted] » Sat, Jul 01, 2023, 4:28 PM UTC

rideontime wrote: post #75

gAI wrote: post #74

Earlier quoted context omitted.

If a medication is incompatible with a person's specific biology, they don’t see improvement (or their health declines). If a function is described incorrectly, you won’t see improved functionality (or you’ll see bugs). It was incompatible with the syntax/compiler/the rest of the code. Though this one won't, LLMs will cite references if asked. They’ll also provide step-by-step rationalization (though they don’t think…

> If a medication is incompatible with a person's specific biology, they don’t see improvement (or their health declines). And the specific ways that their health might decline have been studied, a list of which is included with every package of the medicine. Maybe you even get regular bloodwork to check for the specific side effects this medicine’s been seen to cause. > If a function is described incorrectly, you wo…

Post by justinclift » Sun, Jul 02, 2023, 4:21 AM UTC

dns_snek wrote: post #76

justinclift wrote: post #58

Earlier quoted context omitted.

Does GPT-4 really never hallucinate? This is the first time I've personally heard someone claiming anything like that, though I don't tend to do anything with LLMs (due to this bullshit factor).

Anyone who says that GPT-4 doesn't hallucinate is either clueless or an AI grifter, though I don't think GP was claiming that, just calling out that GPT-3.5 is really, really bad at it.