Earlier quoted context omitted.
>LLMs can't generally reverse implications, that's what the paper says No that's not what the paper says. It says training won't immediately store this information in a way as to make it reversible. Let's get one thing straight. This is a common problem for human learning as well. Anyone who has used Anki for language learning will tell you that if you just train on target language word on the front and native langua…
Humans have reasoning capabilities that are separate from memory. If you want to show that LLMs have reasoning capability you try to create carefully constructed adversarial experiments that try to distinguish between that hypothesis and others, you do not just show that there are cases that favor your hypothesis. And although it's a complete waste of time because the answer is obvious when you do do these types of a…
Re: Is the reversal curse in LLMs real?
#211edit: I meant to say "consistent with your hypothesis" not "favor your hypothesis"