Live data from Hacker News

Are LLMs able to notice the “gorilla in the data”?

chiraaggohel.com

161–170 of 207 posts

Re: Are LLMs able to notice the “gorilla in the data”?

#161
post #77

Earlier quoted context omitted.

This is literally how human brains work: https://www.npr.org/2010/05/19/126977945/bet-you-didnt-notic...

Given I knew what the test was before seeing one of these videos (yes, there is more than one), I find it extra weird that I still didn't see the gorilla the first time. Now, I see it every time.

This is a serious spoiler, perhaps delete your comment and rephrase it?

Re: Are LLMs able to notice the “gorilla in the data”?

#162
post #144

Earlier quoted context omitted.

There actually is an episode of TNG similar to that. The society stopped being able to think for themselves, because the AI did all their thinking for them. Anything the AI didn’t know how to do, they didn’t know how to do. It was in season 1 or season 2.

I pasted your comment into mistral small latest, google, gpt 4o and gpt 4o with search. They all have a different answe, only the last gave a real episode but it said 11001001 in season 1. It said episode 15, it’s actually 14. But even that seems wrong. Are they censored from showing this cautionary tale?? Hah.

No, they just don't have perfect memory.

Re: Are LLMs able to notice the “gorilla in the data”?

#163
post #77

Earlier quoted context omitted.

Given I knew what the test was before seeing one of these videos (yes, there is more than one), I find it extra weird that I still didn't see the gorilla the first time. Now, I see it every time.

This is a serious spoiler, perhaps delete your comment and rephrase it?

A spoiler for a fifteen year old news story that describes this in the middle of the article, explaining what was already at the time a ten year old video, where my anecdote demonstrates that even prior warning isn't sufficient to see it?

Re: Are LLMs able to notice the “gorilla in the data”?

#164

Earlier quoted context omitted.

There actually is an episode of TNG similar to that. The society stopped being able to think for themselves, because the AI did all their thinking for them. Anything the AI didn’t know how to do, they didn’t know how to do. It was in season 1 or season 2.

The Machine Stops also touches on a lot of these ideas and was written in 1909! -- "The story describes a world in which most of the human population has lost the ability to live on the surface of the Earth. Each individual now lives in isolation below ground in a standard room, with all bodily and spiritual needs met by the omnipotent, global Machine. Travel is permitted but is unpopular and rarely necessary. Commun…

I read this story a few years ago and really liked it, but seem to have forgotten the entire plot. Reading it now, it kind of reminds me of the plot of Silo.

Re: Are LLMs able to notice the “gorilla in the data”?

#165

This could serve as a subplot for a sci-fi story: alien are trying for decades to contact by sending out encoded messages. Because the first sentinels are powerful AI, and only analyzed the data pattern, humanity was ignorant of the messages for decades. Until one day, a young astronomer played with the data and asked the AI to plot and visualize in many different ways, just for fun and suddenly realized the hidden i…

Have you seen the film Contact?

Re: Are LLMs able to notice the “gorilla in the data”?

#167

Earlier quoted context omitted.

There actually is an episode of TNG similar to that. The society stopped being able to think for themselves, because the AI did all their thinking for them. Anything the AI didn’t know how to do, they didn’t know how to do. It was in season 1 or season 2.

The Machine Stops also touches on a lot of these ideas and was written in 1909! -- "The story describes a world in which most of the human population has lost the ability to live on the surface of the Earth. Each individual now lives in isolation below ground in a standard room, with all bodily and spiritual needs met by the omnipotent, global Machine. Travel is permitted but is unpopular and rarely necessary. Commun…

> Those who do not accept the deity of the Machine are viewed as 'unmechanical'

From the moment I understood the weakness of my flesh, it disgusted me. I craved the strength and certainty of steel. I aspired to the purity of the blessed machine.

Re: Are LLMs able to notice the “gorilla in the data”?

#168

Earlier quoted context omitted.

> That there was a revolt against thinking machines... Yes... > ...because humans had become too dependent on them for thinking. ... but no. The causes of the Butlerian Jihad are forgotten (or, at least, never mentioned) in any of Frank Herbert's novels; all that's remembered is the outcome.

>> ...because humans had become too dependent on them for thinking. > ... but no. The causes of the Butlerian Jihad are forgotten (or, at least, never mentioned) in any of Frank Herbert's novels; all that's remembered is the outcome. Per Wikipedia or Goodreads, God Emperor of Dune has "The target of the Jihad was a machine-attitude as much as the machines...Humans had set those machines to usurp our sense of beauty,…

Human: Go forth and destroy everything!

Machine: Ok.

Human: HOW COULD YOU DO THISSSS

Re: Are LLMs able to notice the “gorilla in the data”?

#169

Earlier quoted context omitted.

I don't know why you would expect it to see a gorilla without an image to look at. Humans can't.

Without an image? No, not at all. It's supposed to make its own image. And it did make its own image. But it didn't properly analyze the image it made.

That's a feature that would need to be implemented. There's no reason to think it could look at the image of the plot it generated automatically, but feeding it the image it generated back to it is no different to if it did view it automatically

Re: Are LLMs able to notice the “gorilla in the data”?

#170
post #142

Earlier quoted context omitted.

Most human self-reflection and to an extent even memory is similarly post-facto, however.

Humans do tend to remember thoughts they had while speaking, thoughts that go beyond what they said. LLMs don’t have any memory of their internal states beyond what they output. (Of course, chain-of-thought architectures can hide part of the output from the user, and you could declare that as internal processes that the LLM does “remember” in the further course if the chat.)

Is it a thought you had or a thought that was generated by your brain?

In any case the end result is the same. You can only infer from what was generated

Post reply on HN