Live data from Hacker News

The Dunning-Kruger effect may just be a data artefact (2020)

mcgill.ca

81–90 of 191 posts

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#81
post #51

Earlier quoted context omitted.

If you ever took psych 101, it was immediately obvious it's mostly horse shit. Made up nonsense theory, with studies that have few participants and are done by people who don't know math.

But the answer to bad science is good science.

I don't know that it's possible in psych. The economics of doing larger scale studies make it extremely difficult.

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#82
post #53
post #27

Earlier quoted context omitted.

I've seen at least 3 different ideas on this topic: - people not skilled in a thing are bad at estimating their skills - people are generally bad at estimating their skills - people skilled in a particular areas often feel they are intellectually fit in other areas Out of these three I feel like there's some truth in it, at least anecdotally.

for the last one, that's the whole story of Socrates being the wisest man because unlike others he knew the bounds of his knowledge: "I seem, then, in just this little thing to be wiser than this man at any rate, that what I do not know I do not think I know either." https://en.wikipedia.org/wiki/I_know_that_I_know_nothing

For those interested, it’s not just in Apology this comes up. In Theaetetus he does a pretty good job disproving that it is even possible to know what knowledge is.

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#83
post #33
post #12

Earlier quoted context omitted.

My experience with new CS grads was that most of them greatly overestimated what they knew, or alternatively, underestimated how much they did not know.

My experience with every person was that most of them overestimate what they know regardless of experience level. You just notice that more in new grads since its easier to tell when people are wrong about simple things than when they are wrong about more difficult things. Software engineers tend to repeat the mantra "you cannot make accurate time estimates". That is true regardless of experience level, and everyone…

[deleted]

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#86
post #10
post #4

It’s obviously real, at least as used in conversation, whether it meets some rigorous definition I’m sure there’s an out, but we’ve all known these people. With vibe coding they’re everywhere. Is this going to be a modern “begging the question” where everyone knows what you mean but someone pipes up that actually the technical meaning is different?

The problem is that the original formulation was "most people" are unaware of being unskilled, but by now the name is used to mean "some group of people" is unaware of being unskilled. In that sense the article confirms that “a small number are", 5-6%, and therefore the effect exists in the colloquial sense but not in the scientific sense. Mentioning the Dunning-Krueger effect incorrectly is wonderfully meta...

The four levels of competence:

  [ Unconscious Incompetence ]  -->  "You don't know what you don't know"
             ↓
  [ Conscious Incompetence ]    -->  "You know what you don't know"
             ↓
  [ Conscious Competence ]      -->  "You know, but you have to think about it"
             ↓
  [ Unconscious Competence ]    -->  "You know it so well, it's second nature"

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#87

Earlier quoted context omitted.

If you ever took psych 101, it was immediately obvious it's mostly horse shit. Made up nonsense theory, with studies that have few participants and are done by people who don't know math.

It is both amazing and saddening to me how you can have such an arrogant view of a whole field with just taking a 101 course.

Psych 101 says stuff like people being more willing to accept a date with a person after a scary experience since they mistake their quick beating heart for love, rather than humans sees a scary experience as a stronger signal of bonding than a casual experience.

There is so much simple tests that they draw extreme conclusions from in the very first lectures you hear, and when they teach those things as true when its highly debatable its hard to not throw the entire field in the trash.

Of course there is probably some good psychology work done, but you shouldn't have so many shoddy examples in the first course then since that gives people a bad taste for the entire field.

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#89
post #35

Earlier quoted context omitted.

> people skilled in a particular areas often feel they are intellectually fit in other areas This I think is a separate phenomenon, maybe Nobel Disease but there might be a more general term, for example that includes celebrities.

It's called "engineer's disease" which is pretty appropriate for this community: https://en.wiktionary.org/wiki/engineer%27s_disease

My experience has been that this isn't limited to engineers. I'm sure most people here have had people from other departments tell them how they need to do their jobs in one way or another.

For example, there are always at least a few people who you have to consult regularly because their tickets are always written how they perceive a problem should be solved rather than explaining the underlying problem to be solved. Then there are the sales and marketing types who like to dictate how the UX of the front-end should be because they like to retell anecdotes to prospective clients about how they solved a problem. Then there's the guy who hands you a spreadsheet he's maintained for years and tells you he wants you to put something exactly like it in the flagship product as a new feature.

Re: The Dunning-Kruger effect may just be a data artefact (2020)

#90
post #33
post #12

Earlier quoted context omitted.

My experience with new CS grads was that most of them greatly overestimated what they knew, or alternatively, underestimated how much they did not know.

My experience with every person was that most of them overestimate what they know regardless of experience level. You just notice that more in new grads since its easier to tell when people are wrong about simple things than when they are wrong about more difficult things. Software engineers tend to repeat the mantra "you cannot make accurate time estimates". That is true regardless of experience level, and everyone…

gell mann effect leads me to pay closer attention and then its game over
Post reply on HN