Making o1, o3, and Sonnet 3.7 hallucinate for everyone

Post by johnisgood » Sat, Mar 01, 2025, 9:37 PM UTC

andix wrote: post #40

pinoy420 wrote: post #32

Earlier quoted context omitted.

A good prompt. You don’t just ask it. You tell it how to behave and give it a shot load of context

With Claude the context window is quite small. But with adding too much context it often seems to get worse. If the context is not carefully narrowly picked and too unrelated, the LLMs often start to do unrelated things to what you've asked. At some point it's not really worth anymore creating the perfect prompt, just code it yourself. Also saves the time to carefully review the AI generated code.

Post by [deleted] » Sat, Mar 01, 2025, 9:39 PM UTC

layer8 wrote: post #89

Chance-Device wrote: post #3

It’s not really hallucinating though, is it? It’s repeating a pattern in its training data, which is wrong but is presented in that training data (and by the author of this piece, but unintentionally) as being the solution to the problem. So this has more in common with an attack than a hallucination on the LLM’s part.

Every LLM hallucination comes from some patterns in the training data, combined with lack of awareness that the result isn’t factual. In the present case, the hallucination comes from the unawareness that the pattern was a proposed syntax in the training data and not an actual syntax.

Post by 1oooqooq » Sat, Mar 01, 2025, 9:40 PM UTC

do_not_redeem wrote: post #12

Chance-Device wrote: post #3

It’s not really hallucinating though, is it? It’s repeating a pattern in its training data, which is wrong but is presented in that training data (and by the author of this piece, but unintentionally) as being the solution to the problem. So this has more in common with an attack than a hallucination on the LLM’s part.

So anyone can make up some random syntax/fact and post it once, and in some cases the model will take it as truth. I don't know if there's a widely agreed-on definition of "hallucination", but if this isn't one, then the distinction is meaningless imo.

Post by mattmanser » Sat, Mar 01, 2025, 9:42 PM UTC

johnisgood wrote: post #94

andix wrote: post #30

I've got a lot of hallucinations like that from LLMs. I really don't get how so many people can get LLMs to code most of their tasks without those issues permanently popping up.

I have made large projects using Claude, with success. I know what I want to do and how to do it, maybe my prompts were right.

Post by johnisgood » Sat, Mar 01, 2025, 9:44 PM UTC

miunau wrote: post #102

johnisgood wrote: post #94

Earlier quoted context omitted.

I have made large projects using Claude, with success. I know what I want to do and how to do it, maybe my prompts were right.

How do you deal with large files? After about a thousand lines in a file, it starts to cough for me. Forgets that some functions exist and makes up inferior duplicate ones.