Position: LLMs Can't Jump
openreview.net
Position: LLMs Can't Jump
1–10 of 233 posts
Re: Position: LLMs Can't Jump
#2Came for:
"A computer once beat me at chess, but it was no match for me at kick boxing."
TFA was actually about leaps of intuition, sadly.
One of the experiments I've heard proposed around here is to somehow create an LLM from all text up to 1980 or 1990 and see if it can get back to making itself.
Re: Position: LLMs Can't Jump
#3Re: Position: LLMs Can't Jump
#4Previous: https://news.ycombinator.com/item?id=49162791
Re: Position: LLMs Can't Jump
#5[flagged]
Re: Position: LLMs Can't Jump
#6Previous: https://news.ycombinator.com/item?id=49162791
Also:
https://news.ycombinator.com/item?id=49136070 https://news.ycombinator.com/item?id=49096837 https://news.ycombinator.com/item?id=46890333 https://news.ycombinator.com/item?id=46870562
All of these are titled “LLMs Can’t Jump”
Re: Position: LLMs Can't Jump
#7[deleted]
Re: Position: LLMs Can't Jump
#8[dead]
Re: Position: LLMs Can't Jump
#9This tracks for me as someone making keeps of intuition in little-explored areas.
I just don't see any of the LLM users around at all. Clearly some force is guiding them all away from thinking any of the "leap of faith" thoughts that I am thinking.
Re: Position: LLMs Can't Jump
#10The theory is that creative leaps in theoretical physics require a grounding in sensory experience, but the obvious counter-argument is that humans can make creative leaps in abstract fields without such sensory grounding. They do address this at the end, saying
"In abstract domains such as Mathematics or Computer Science, the Sense Experience (E) may be grounded in high-dimensional topology or have other goals such as generality or minimality."
But if such sense experience is possible in abstract domains via some high-dimensional topology, why could a sufficiently advanced LLM not develop an equivalent high-dimensional topology for domains like physics and use it to make creative leaps?