Are LLMs able to notice the “gorilla in the data”?
chiraaggohel.com
Are LLMs able to notice the “gorilla in the data”?
1–10 of 207 posts
Re: Are LLMs able to notice the “gorilla in the data”?
#2That's done on purpose. The AI can't easily tell whether the drawing might be intended to be one of a human or a gorilla, so when in doubt it doesn't want to commit either way and just ignores the topic altogether. It's just another example of AI ethics influencing its behavior for alignment purposes.
Re: Are LLMs able to notice the “gorilla in the data”?
#3[flagged]
Re: Are LLMs able to notice the “gorilla in the data”?
#4That's done on purpose. The AI can't easily tell whether the drawing might be intended to be one of a human or a gorilla, so when in doubt it doesn't want to commit either way and just ignores the topic altogether. It's just another example of AI ethics influencing its behavior for alignment purposes.
You mean that whole post could have been written:
"AI can't see gorilla because wokification"?
/s
Edit: Adding /s Thought "wokification" already signalled that.
Re: Are LLMs able to notice the “gorilla in the data”?
#5GPT can't "see" the results of the scatterplot (unless prompted with an image), it only sees the code it wrote. If a human had the same constraints I doubt they'd identify there was a gorilla there.
Take a screenshot of the scatterplot and feed it into multimodal GPT and it does a fine job at identifying it.
EDIT:
Sorry, as a few people pointed out, I missed the part where the author did feed a PNG into GPT. I kind of jumped to conclusions when it worked fine for me. I still maintain that the article's conclusion ("Your AI Can't See Gorillas") is overly broad, given that I had no trouble getting it to see one.
But I wonder why the author had trouble? My suspicion is that AI got stuck on summary statistics because the previous messages in the chat were all about summary statistics.
Re: Are LLMs able to notice the “gorilla in the data”?
#6I'm not sure I'd be able to tell it was supposed to be a gorilla specifically, without context.
Re: Are LLMs able to notice the “gorilla in the data”?
#7Can it draw the unicorn yet?
Re: Are LLMs able to notice the “gorilla in the data”?
#8If you give the graph as image to the model they will easily see the monkey: "I see a drawing of a monkey outlined with red and blue dots.", if you give them coordinates than they will much more struggle with it like a human would do.
Re: Are LLMs able to notice the “gorilla in the data”?
#9That's done on purpose. The AI can't easily tell whether the drawing might be intended to be one of a human or a gorilla, so when in doubt it doesn't want to commit either way and just ignores the topic altogether. It's just another example of AI ethics influencing its behavior for alignment purposes.
What specifically do you base this on? It sounds like conjecture.
Re: Are LLMs able to notice the “gorilla in the data”?
#10[flagged]
That has nothing to do with this article. Wrong gorilla.