Live data from Hacker News

Differences in link hallucination and source comprehension across different LLM

mikecaulfield.substack.com

11–20 of 47 posts

Re: Differences in link hallucination and source comprehension across different LLM

#11
post #10

Earlier quoted context omitted.

[flagged]

Languages evolve and words get new meanings all the time.

Yeah the meaning was what I said until about 2 weeks ago when someone went viral talking about air travel without a cellphone.

Do vulgarities often become accepted?

Re: Differences in link hallucination and source comprehension across different LLM

#12
post #7

Earlier quoted context omitted.

I have search enabled 100% of the time with ChatGPT and would never go back to raw-dogging LLM citations. O3 especially has passed the threshold of “not always annoying”. Had an argument with Gemini yesterday where it was insisting on some hallucinated implementation of a function even while giving me a GitHub link to the correct source.

[flagged]

Are you being paid to post here? They're giving me nothing. Cheapskates.

Re: Differences in link hallucination and source comprehension across different LLM

#13
post #7

Earlier quoted context omitted.

I have search enabled 100% of the time with ChatGPT and would never go back to raw-dogging LLM citations. O3 especially has passed the threshold of “not always annoying”. Had an argument with Gemini yesterday where it was insisting on some hallucinated implementation of a function even while giving me a GitHub link to the correct source.

[flagged]

I wouldn't use it in a workplace either, perhaps not at all, but here is a pseudonymous forum. The expectations—or repercussions—of decorum aren't the same.

Re: Differences in link hallucination and source comprehension across different LLM

#14
post #7

Earlier quoted context omitted.

I have search enabled 100% of the time with ChatGPT and would never go back to raw-dogging LLM citations. O3 especially has passed the threshold of “not always annoying”. Had an argument with Gemini yesterday where it was insisting on some hallucinated implementation of a function even while giving me a GitHub link to the correct source.

[flagged]

I think the usage and all its connotations are perfectly cromulent here.

Re: Differences in link hallucination and source comprehension across different LLM

#15
> Why are we talking about “graduate and PhD-level intelligence” in these systems if they can’t find and verify relevant links

For exactly the same reason the author markets his tool as a research assistant

> It also models an approach that is less chatbot, and more research assistant in a way that is appropriate for student researchers, who can use it to aid research while coming to their own conclusions.

Re: Differences in link hallucination and source comprehension across different LLM

#16
post #4

Taken from the blog: > Why are we talking about “graduate and PhD-level intelligence” in these systems if they can’t find and verify relevant links — even directly after a search? This is my pet peeves, and recently OpenAI's models seem to have become very militant in how they stand by and push their obviously hallucinated sources. I'm talking about hallucinating answers, when pressed to cite sources they also halluc…

Including literal 404s... As an outsider it has always struck me as absurd that they don't just do the equivalent of wget over all provided sources.

Re: Differences in link hallucination and source comprehension across different LLM

#17
post #10

Earlier quoted context omitted.

Languages evolve and words get new meanings all the time.

Yeah the meaning was what I said until about 2 weeks ago when someone went viral talking about air travel without a cellphone. Do vulgarities often become accepted?

Are we allowed to say "sex" or "kill"? Or do we have to start s*lf-c*nsoring everything?

Anyway, my last search to how to un-alive children processes gave me nothing. I wonder if those m*n pages are actually wr*tten by pr*f*ss*n*ls.

Re: Differences in link hallucination and source comprehension across different LLM

#18
It's not just that they get links wrong, it's how they get them wrong – like, totally fabricating them and then doubling down! A human messing up a citation is one thing, but this feels... different, almost like a creative act of deception, lol.

Re: Differences in link hallucination and source comprehension across different LLM

#19
post #10

Earlier quoted context omitted.

Languages evolve and words get new meanings all the time.

Yeah the meaning was what I said until about 2 weeks ago when someone went viral talking about air travel without a cellphone. Do vulgarities often become accepted?

[deleted]

Re: Differences in link hallucination and source comprehension across different LLM

#20
post #10

Earlier quoted context omitted.

Languages evolve and words get new meanings all the time.

Yeah the meaning was what I said until about 2 weeks ago when someone went viral talking about air travel without a cellphone. Do vulgarities often become accepted?

[deleted]
Post reply on HN