Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

"Hallucinating" AIs sound creative, but let's not celebrate being wrong

thereader.mitpress.mit.edu

Post reply on HN
Print view View original

1–10 of 196 posts

Re: "Hallucinating" AIs sound creative, but let's not celebrate being wrong

#3

Post by Zigurd »

"Hallucinating" is really a euphemism for fluent bullshitting. It also doesn't fit the normal understanding of a hallucination. It's just wrong information expressed confidently. Partly it's how the conversational UI works, and partly how the model works. Without the nice generated text that creates in our minds an impression of competence, it would just be an error.

Re: "Hallucinating" AIs sound creative, but let's not celebrate being wrong

#4

Post by ethanbond »

glasss wrote: post #2

I really didn't think anyone was applauding the "hallucinations" but maybe I just hang around people who aren't visionaries.

I've seen more and more of it over the past few weeks. I work in clinical trials and just recently saw the claim that hallucinations can help researchers "expand the search space for molecules they didn't consider." I'm doubtful...

Re: "Hallucinating" AIs sound creative, but let's not celebrate being wrong

#6

Post by rdedev »

It's better to treat llms as more of a language encoders and decoders and have some for of intermediate representation where facts are verifiable. Or some form of a validation mechanism that isn't exactly checked against the generated texts. Pretty sure there are people working on integrating stuff like knowledge based but state of the art llms don't seem to have any kind of fact verification mechanism built in
Post reply on HN