Live data from Hacker News

The Dunning-Kruger effect may just be a data artefact (2020)

mcgill.ca

161–170 of 191 posts

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#161

Earlier quoted context omitted.

Maybe the problem is that DK isn't about individuals, but about topics? I.e. perhaps everyone exhibits the phenomenon about topics they are most ignorant about. (and I am ignorant about DK, so...)

No, I think it's about people - about us. About you, me, all of us.

We are the answer.

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#162

The reason people find the DK effect persuasive is that everyone has run into this many times in their own lives. Like with an idiot boss who thinks he knows your job better than you do, or an article by someone that gets things completely wrong about a topic that you yourself know very well, through personal experience or extensive study. And we have all been dismayed about the impact such people can have, like thro…

>If the research can't demonstrate the DK effect, then the research is bad, like poorly designed.

I don't have an opinion about Dunning-Kruger either way, but I wanted to point out that this is a pre-replication crisis mindset. Social psychology spent decades producing catchy, intuitive results that turned out not to replicate. We've learned over and over that we can't trust it when a result feels right, we need to rely on proven statistical methods.

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#164

Earlier quoted context omitted.

Maybe the problem is that DK isn't about individuals, but about topics? I.e. perhaps everyone exhibits the phenomenon about topics they are most ignorant about. (and I am ignorant about DK, so...)

No, I think it's about people - about us. About you, me, all of us.

What is amusing to me is when I think about what happens when the so called "experts" have this effect? Because "experts" are people too...

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#165

The reason people find the DK effect persuasive is that everyone has run into this many times in their own lives. Like with an idiot boss who thinks he knows your job better than you do, or an article by someone that gets things completely wrong about a topic that you yourself know very well, through personal experience or extensive study. And we have all been dismayed about the impact such people can have, like thro…

We want theories to be backed by more rigorous data precisely because "having run into this many times in their own lives" is not reliable. People's own perception is incredibly biased. We can see a bias at play in your very own closing sentence — "your study is bad if it doesn’t not confirm my existing belief" is plainly not science.

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#166
post #164

Earlier quoted context omitted.

No, I think it's about people - about us. About you, me, all of us.

What is amusing to me is when I think about what happens when the so called "experts" have this effect? Because "experts" are people too...

https://xkcd.com/793

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#167

Man sets out to write article on DK Effect, comes across one skeptical study, confidently writes article refuting DK Effect. It writes itself.

Weird take. The author corresponded with Dunning and reproduced the classic graph using random data.

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#168
post #55

The key claim: "Random data actually mimics the effect really well." This makes some sense. If people are asked to guess a number between 1 and 6 and then roll a die, the people who roll low are more likely to overestimate and the people who roll high are more likely to underestimate. But the key is precisely how well random data mimics the effect.

They're simulating randomness incorrectly: relationship between true and perceived will average 0.5, not 0; and bias will average 50%, not 0%. That's why their "random data" is sloped. Add negative relationship and negative bias, and the random data will act as intended - hovering randomly around 50%.

Is this correct? I was fairly certain that the correlation between random data points approached 0.

Is it also plausible that the relationship between true and percieved is wholly independent (as this presumes)?

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#170

The reason people find the DK effect persuasive is that everyone has run into this many times in their own lives. Like with an idiot boss who thinks he knows your job better than you do, or an article by someone that gets things completely wrong about a topic that you yourself know very well, through personal experience or extensive study. And we have all been dismayed about the impact such people can have, like thro…

Confirmation bias. You don't notice when people back down from their bad takes because that's normal and expected. Or possibly just selection bias if you are in situations where people are more likely to be arrogant.
Post reply on HN