Can it draw the unicorn yet? https://gpt-unicorn.adamkdean.co.uk/
Claude 3.5 Sonnet is much better at it: https://claude.site/artifacts/ad1b544f-4d1b-4fc2-9862-d6438e...
But I guess GPT-4o results are more funny to look at.
Are LLMs able to notice the “gorilla in the data”?
11–20 of 207 posts
Re: Are LLMs able to notice the “gorilla in the data”?
#12GPT can't "see" the results of the scatterplot (unless prompted with an image), it only sees the code it wrote. If a human had the same constraints I doubt they'd identify there was a gorilla there. Take a screenshot of the scatterplot and feed it into multimodal GPT and it does a fine job at identifying it. EDIT: Sorry, as a few people pointed out, I missed the part where the author did feed a PNG into GPT. I kind o…
Does ChatGPT even have access to the raw data points or does it just know the path to some CSV?
The contents of the CSV might be entirely unknown at inference time.
Re: Are LLMs able to notice the “gorilla in the data”?
#13That's done on purpose. The AI can't easily tell whether the drawing might be intended to be one of a human or a gorilla, so when in doubt it doesn't want to commit either way and just ignores the topic altogether. It's just another example of AI ethics influencing its behavior for alignment purposes.
You didn’t read the article eh?
You just assumed it’s similar to the Google situation a few years back where they banned their classifier from classifying images as gorillas. It isn’t.
Re: Are LLMs able to notice the “gorilla in the data”?
#14That's done on purpose. The AI can't easily tell whether the drawing might be intended to be one of a human or a gorilla, so when in doubt it doesn't want to commit either way and just ignores the topic altogether. It's just another example of AI ethics influencing its behavior for alignment purposes.
You mean that whole post could have been written: "AI can't see gorilla because wokification"? /s Edit: Adding /s Thought "wokification" already signalled that.
You didn’t read it either.
Re: Are LLMs able to notice the “gorilla in the data”?
#15GPT can't "see" the results of the scatterplot (unless prompted with an image), it only sees the code it wrote. If a human had the same constraints I doubt they'd identify there was a gorilla there. Take a screenshot of the scatterplot and feed it into multimodal GPT and it does a fine job at identifying it. EDIT: Sorry, as a few people pointed out, I missed the part where the author did feed a PNG into GPT. I kind o…
Before seeing Claude’s response, did you see where the author said
> I asked the model to closely look at the plot, and also uploaded a png of the plot it had generated.
Re: Are LLMs able to notice the “gorilla in the data”?
#16That's done on purpose. The AI can't easily tell whether the drawing might be intended to be one of a human or a gorilla, so when in doubt it doesn't want to commit either way and just ignores the topic altogether. It's just another example of AI ethics influencing its behavior for alignment purposes.
Um, no. That is even't close to the truth. The AI doesn't "want" anything. It's a statistical prediction process, and it certainly has nothing like the self-reflection you are attributing to it. And the heuristic layers on top of LLMs are even less capable of doing what you are claiming.
Re: Are LLMs able to notice the “gorilla in the data”?
#17Re: Are LLMs able to notice the “gorilla in the data”?
#18That's done on purpose. The AI can't easily tell whether the drawing might be intended to be one of a human or a gorilla, so when in doubt it doesn't want to commit either way and just ignores the topic altogether. It's just another example of AI ethics influencing its behavior for alignment purposes.
It's not that at all... Similar drawings of non-humanoid shapes like an ostrich or the map of Europe would have resulted in the exact same 'blindness'.
Re: Are LLMs able to notice the “gorilla in the data”?
#19GPT can't "see" the results of the scatterplot (unless prompted with an image), it only sees the code it wrote. If a human had the same constraints I doubt they'd identify there was a gorilla there. Take a screenshot of the scatterplot and feed it into multimodal GPT and it does a fine job at identifying it. EDIT: Sorry, as a few people pointed out, I missed the part where the author did feed a PNG into GPT. I kind o…
Before seeing Claude’s response, did you see where the author said > I asked the model to closely look at the plot, and also uploaded a png of the plot it had generated.
I sent the plot to ChatGPT 4o. Here is the conversation:
what do you see
ChatGPT said:
This is a scatter plot with the variables "steps" on the x-axis and "bmi" on the y-axis. The data points are colored by "gender" (red for female and blue for male). Interestingly, the arrangement of the points appears to form a drawing resembling a cartoonish figure or character, likely added for artistic or humorous effect.
If you'd like, I can help analyze or discuss the data further!
You said:
Wha the cartoonish figure looks like ?
ChatGPT said:
The cartoonish figure in the plot resembles a stylized gorilla or monkey-like character. It appears to be waving with one hand raised, while the other arm is resting downward. The face is expressive, with distinct eyes, a nose, and a slightly frowning mouth. The overall pose gives it a somewhat playful or cheeky vibe.
Re: Are LLMs able to notice the “gorilla in the data”?
#20If you give the graph as image to the model they will easily see the monkey: "I see a drawing of a monkey outlined with red and blue dots.", if you give them coordinates than they will much more struggle with it like a human would do.
Nope, any human when asked to plot that data would pretty quickly give up and (correctly) assume it was a wind-up.