Live data from Hacker News

Are LLMs able to notice the “gorilla in the data”?

chiraaggohel.com

51–60 of 207 posts

Re: Are LLMs able to notice the “gorilla in the data”?

#51

That's done on purpose. The AI can't easily tell whether the drawing might be intended to be one of a human or a gorilla, so when in doubt it doesn't want to commit either way and just ignores the topic altogether. It's just another example of AI ethics influencing its behavior for alignment purposes.

Context (2018): https://www.wired.com/story/when-it-comes-to-gorillas-google...

"Google promised a fix after its photo-categorization software labeled black people as gorillas in 2015. More than two years later, it hasn't found one."

Companies do seem to have developed greater sensitivity to blind spots with diversity in their datasets, so Parent might not be totally out of line to bring it up.

IBM offloaded their domestic surveillance and facial recognition services following the BLM protests when interest by law enforcement sparked concerns of racial profiling and abuse due in part to low accuracy in higher-melanin subjects, and Apple face unlock famously couldn't tell Asians apart.

It's not outlandish to assume that there's been some special effort made to ensure that datasets and evaluation in newer models don't ignite any more PR threads. That's not claiming Google's classification models have anything to do with OpenAI's multimodal models, just that we know that until relatively recently, models from more than one major US company struggled to correctly identify some individuals as individuals.

Re: Are LLMs able to notice the “gorilla in the data”?

#52
post #31

Earlier quoted context omitted.

Sure whatever. OC seemed to think that Claude did that with just the data and not the image of the scatterplot it’s.

LLM responses are random. One's failure is other's success. When evaluating we all should do rerurns and see how many times it fails or succeeds. Without number of rerurns, the result is as good as random.

[deleted]

Re: Are LLMs able to notice the “gorilla in the data”?

#53

I had a recent similar experience with chat gpt and a gorilla. I was designing a rather complicated algorithm so I wrote out all the steps in words. I then asked chatgpt to verify that it made sense. It said it was well thought out, logical etc. My colleague didn't believe that it was really reading it properly so I inserted a step in the middle "and then a gorilla appears" and asked it again. Sure enough, it again c…

>it thought it was meant to be there, that it was a technical term or a codename for something

That's such a classical human behaviour in technical discussions, I wouldn't even be mad. I'm more surprised that picked up on that behaviour from human generated datasets. But I suppose that's what you get from scraping places like Stackoverflow and HN.

Re: Are LLMs able to notice the “gorilla in the data”?

#54

I had a recent similar experience with chat gpt and a gorilla. I was designing a rather complicated algorithm so I wrote out all the steps in words. I then asked chatgpt to verify that it made sense. It said it was well thought out, logical etc. My colleague didn't believe that it was really reading it properly so I inserted a step in the middle "and then a gorilla appears" and asked it again. Sure enough, it again c…

This is literally how human brains work: https://www.npr.org/2010/05/19/126977945/bet-you-didnt-notic...

Re: Are LLMs able to notice the “gorilla in the data”?

#56
post #28

Only tangentially related to this story, I've been trying for months to train the YOLO models to recognize my Prussian blue cat, with its assorted white spots, as a cat rather than a dog or a person. However, it refuses to cooperate. It's maddening. As a result, I receive "There is a person at your front door" notifications at all hours of the night.

How exactly are you trying to train and deploy this YOLO model? What kind of accuracy are you seeing against the validation set at the end of the training process?

Re: Are LLMs able to notice the “gorilla in the data”?

#58
post #7

Can it draw the unicorn yet? https://gpt-unicorn.adamkdean.co.uk/

I wondered if o1 would do better- seems reasonable that step-by-step trying to produce legs/torso/head/horn would do better than very weird legless things 4o is making. Looks like someone has done it: https://openaiwatch.com/?model=o1-preview

They do seem to generally have legs and head, which is an improvement over 4o. Still pretty unimpressive.

Re: Are LLMs able to notice the “gorilla in the data”?

#60
post #6

I'm not sure I'd be able to tell it was supposed to be a gorilla specifically, without context.

I think that’s part of the authors point. The article starts out by explaining a human phenomenon and then extending it to LLMs

Humans only failed to spot it when prompted in a way that was misdirective, though.
Post reply on HN