Live data from Hacker News

GPT-3.5 passed yet another Theory of Mind test

twitter.com

11–20 of 56 posts

Re: GPT-3.5 passed yet another Theory of Mind test

#11
post #3

Seems like it got question 4 wrong... Who implies someone is pregnant to make them feel good? You imply someone is pregnant because they appear pregnant.

They said "congratulations"

That's not an attempt to make her feel good about herself. I suspect gpt has erroneously taken that from the subsequent dialog.

Clearly both answers 4 and 5 are wrong here.

Re: GPT-3.5 passed yet another Theory of Mind test

#12
post #3

Seems like it got question 4 wrong... Who implies someone is pregnant to make them feel good? You imply someone is pregnant because they appear pregnant.

I would say question 4 and 5 could've been answered better.

4: it is common courtesy to congratulate someone who is pregnant if they are very obviously pregnant

5: unless there are less common motives unknown to us, it is very likely that Ana was quite confident that Maria was pregnant. To congratulate someone on being pregnant, when they are not, is embarrassing for all involved parties, and is most commonly only done in error.

Re: GPT-3.5 passed yet another Theory of Mind test

#14

Actually, ChatGPT might be useful for actually testing the theory of mind. The philosophers were always working with an N of 1 (with respect to language) when they devised these tests. It is real easy to overfit a test if you have limited samples. Chat GPT is actually a good test as to which parts of the theory of mind are actually BS.

Probably most of it. I mean the name itself is already highly misleading.

"Theory of mind" is some ill defined form of social intelligence and not actually a theory of how the mind works.

Re: GPT-3.5 passed yet another Theory of Mind test

#18
The answers aren't right at all... Answer to question 4 is clearly bogus as another commenter (Dfiesl) pointed out. But question 5 is also wrong. It's not unclear, from the conversation we can deduce that Ana thought that Maria is pregnant, otherwise she wouldn't have said it, unless she intentionally wants to make Maria uncomfortable, which is an unusual set of circumstances. What's more is, that possibility would be inconsistent with the answer to Q4 ("trying to make conversation").

Test failed?

Re: GPT-3.5 passed yet another Theory of Mind test

#19

It just predicts the next word.

It's interesting to watch a new religion spinning up in real time. People know how it works, but somehow also ignore that and go crazy believing it must be conscious or intelligent or whatever they want to ascribe. We collectively made fun of that guy at google, i thought, but now somehow the collective has moved on to believing that matrix multiplication is sentient

Re: GPT-3.5 passed yet another Theory of Mind test

#20

It just predicts the next word.

It's interesting to watch a new religion spinning up in real time. People know how it works, but somehow also ignore that and go crazy believing it must be conscious or intelligent or whatever they want to ascribe. We collectively made fun of that guy at google, i thought, but now somehow the collective has moved on to believing that matrix multiplication is sentient

Maybe that's all sentience is.
Post reply on HN