Live data from Hacker News

In Defense of Myers Briggs (2020)

dynomight.net

281–290 of 352 posts

Re: In Defense of Myers Briggs (2020)

#281
post #243

Earlier quoted context omitted.

>Some people find it helps them understand themselves better. Some people have said the same of astrological signs. (EDIT: As per @simias' comment on confirmation bias. This is why "text blurb profile"-oriented reasoning is especially suspect. We already have ample evidence of that reasoning being as unreliable guide to truth as is unreliable a belief that your birthday determines your personality.)

MBTI results correlate moderately to strongly with Big 5 scores. Is Big 5 equivalent to astrology too?

These are answers to a standardized test. So, they are (probably) teasing out some tiny kernel of truth in the distribution of (probably context sensitive) human traits (insofar as these traits are related to the questions, but probably more dubiously insofar as people use English words like "intuitive" for axes or name one axis two different English ideas like Judging and Perceiving).

Honestly, the more "words" you add to try to summarize a pile of question answers, the further away you are getting from "science" and the closer you get to astrology. If there is only one lesson I can convey here, it should be that. The science is the 50 or however many questions dimensional questionnaire and the 4 or 5 dimensional distributional summary of the full high dimensional distribution. You project "down from the questions" to the summary and then people using English "back project" but are mostly just filling in poetic detail from anecdotal experience. The bigger that back projection to paragraphs and chapters the more like astrology or psychology by and for poets things have become.

However, as mentioned a couple of times, these summaries may be telling you very little (not "probably says" as you say a few times, but "probably says nothing") about the 99% neurotypical people (yes, my estimate is hand-wavy based on the distribution along just one axis from the article which says the other are "similar"). The tests may be only useful to identify outlying personality extremes which is very much not how amateurs apply them. Amateurs overconclude..reading profiles and basically acting out the epistemological play of astrology over again (but backed by "science" so they feel less guilty; EDIT - and yes I have known several such people in real life).

Incidentally, this also explains "correlations" with other things (like IQ or engineers or etc.) because linear statistics like correlation are notoriously dragged around by outliers. To whatever extent these things are true, the correlations (unadjusted for individual noise as already mentioned) will have much weaker statistical power than you would naively expect. In effect, your sample size may be only 0.2% to a few % what you thought it was. So, instead of 1000s of people you have 10s with thin population of each of the 16 categories. This would show up in the reproducibility of the correlation studies, but honestly require a more careful meta-analysis than I am prepared to offer for free. So, these studies, too, may have a grain of truth, but perhaps only a grain and this grain is probably much smaller than what personality test advocates in this comment thread seem to understand.

At least one real world problem with taking these measurements too seriously is, as others in this thread have mentioned, that these thinly evidenced divisions - even if real - can be as ripe for abuse as race/whatever designator is. In-group preference [1] is a strongly replicated result in psychology. This is another reason why axes-only "a% I, b% N, c% T, d% P" are better than classification, and why the big 5 (which at least resists categories) is less harmful. a +- A, b +- B, etc. would be even better.

Have you or anyone on this whole thread ever heard of a p-value for your personality assignment or error bars on your personality axes before I mentioned them? (Yes, I know the problems with p-values. Those problems are not the point here.) No? Yet everyone has heard of same-person reproducibility problems. These are obviously deeply related issues.

So, the problem is not that "MB is totally not science". It's that personality measurement in general is weak enough science to be far more likely to be misapplied than to be correctly understood, especially by lay practitioners like HR depts/mgmt/people on first dates/people in emotionally heated scenarios. It may have a real and even positive role in diagnosing true outlier children in need of interventions, though "profiles" of all the super extreme 16 cases will probably sound bad and may be obvious sans any testing.

[1] https://en.wikipedia.org/wiki/In-group_favoritism

Re: In Defense of Myers Briggs (2020)

#282
post #65

Earlier quoted context omitted.

In grad school I joined an extracurricular social society where you meet around a table with other grad students and discuss various topics selected in advance while eating pie and other goodies. Sort of like debate but without the structure or positions. Anyway one time the topic was Myers Briggs and so we all filled out our profiles in advance so we'd have something to discuss. It was a group of 20 people, and we d…

Or INTJ is what you get when you answer questions in a way that you expect to be conforming to what your fellow grad students will respect, before going to a meeting and revealing your result to them.

No. That's a very clever and cynical viewpoint but realistically, none of us cared about that. It's not like these were peers in the same lab whose opinion mattered. Nor did anyone really have a strong opinion about meyers briggs categories. If anything it almost got a little embarassing after the first five replies to keep answering the same thing as the other people - like going to a restaurant and everyone ordering, one after the next, that they want the blueberry pancakes. You almost feel like an automaton instead of being a unique and creative individual.

Re: In Defense of Myers Briggs (2020)

#283

Earlier quoted context omitted.

If the best way we have to measure something is very bad, perhaps it's best to say we just can't measure it and keep looking, rather than using a very bad measure. It's like instead of trying to invent scales, we kept trying to measure objects' mass by their volume, which happens to work decently for many common objects, bud fails spectacularly for others. And instead of admitting we just can't measure mass, we'd fil…

Don't you first have to define what you want to measure and demonstrate that it exists?

Only if you're doing science. It's possible to find things out without science slowing you down, but I wouldn't ordinarily recommend it; science is a great way to avoid the common traps that humans invariably fall into when they try to bypass the scientific method.

Re: In Defense of Myers Briggs (2020)

#284
post #186

Earlier quoted context omitted.

I never thought about the lack of a neutral trait, but you are right. However I don't think there's any reason to expect these traits to have a normal distribution. Humans have plenty of bimodal-ish traits.

The Central Limit Theorem is one big reason to expect that traits have a normal distribution. Wikipedia has a good explanation. [1] and [2] [1] https://en.wikipedia.org/wiki/Central_limit_theorem [2] https://en.wikipedia.org/wiki/De_Moivre–Laplace_theorem

Central limit theorem does not apply unless each experiment is independent. This is not true of the concepts which psychometrician operationally define including personality factors and intelligence.

As an example: Human height is not normally distributed. It is multi-modal based on geographical location, socioeconomic status and sex. There are genetic and environmental factors that makes it so that each childbirth is not an independent event marking a new height.

The same holds for personality traits (if they exists) and intelligence (if it exists as described by IQ tests). The field of psychometrics has a problem with assigning normal distribution to everything even though there is reason to belief things are not normally distributed.

Re: In Defense of Myers Briggs (2020)

#285

Earlier quoted context omitted.

But surely the social consensus that engineers are more prestigious than nurses is on the society and not on Peterson. It might be difficult to predict the success of somebody via IQ if you compare two individuals from radically different socio-economic backgrounds, but you can compare two individuals with different IQs from similar socio-economic backgrounds and statistically IQ is a very good predictor of success.…

> countries that have the free-est social expectations(e.g. Scandinavian countries) have the most diverse differences between men and women. From my personal experience going to a university in the UK and studying CS, I could count maybe 3-5 women out of a cohort of 350+ students. I don't think you can accuse the UK of actively discouraging women from joining these fields, quite the opposite. So why don't they choose…

>Well, there are two options: either this is right and there is a vast gulf between the workings of the male and female mind, or these countries are not as free of social expectations as they like to think they are. Not sure how the UK and Northern Europe compare, but a (female) friend who left Romania for Germany was shocked at how large the social pressure on women to give up working after having a child are. She has had multiple colleagues directly and indirectly pushing her into feeling like a bad mother for holding a full-time job while having a child at home.

Yes, it seems even the most progressive countries haven't eliminated all pressure yet. And that might be for the best, but that's besides the point.

>In my own university days in the CS department, there was a marked difference between the number of men and women, but nowhere near what you're saying: it was more like 10 women for every 20 men, maybe a little less. I've had several female professors, including the head of the Polytechnic institute and the head of the CS department. In my job today, I am on a team of 4 men and 3 women (all programmers), working on a project with a female project lead, and probably overall 30 men and 6 women in Dev, and 50 men and 14 women if you include QA (who also do Python-based automated testing). This is on a project deep in the world of computer networking, not some soft field. And the team is about half in Romania, half in India - not exactly countries known for their courageous tearing down of social norms.

Peterson and the study that he referenced specifically did point out that the less pressured men and women are to follow a path the more pronounced the differences become. So far your anecdote, as well as my own from previously living in an ex-USSR country, confirm this. Why this is so - I have no idea but I find it fascinating.

>Well, if he's saying that women are more fit to be nurses and men are more fit to be engineers, than I feel justified in saying that he's implying women are less suited than men for intellectual labor (not necessarily dumber, but at least less likely to enjoy it). That may not be his intention (though I believe it may well be), but he also doesn't go out of his way to disclaim it.

Whilst Peterson never specifically said that men are more fit to be engineers than women, I do agree that what he HAS said is analogous to that. However, I believe his views on that came from evidence and not from a sexist point-of-view that women are inferior. The inverse of that is that women are better at child-rearing and people-facing roles, a statement which I think is on average just as true as the one about men and engineers. Is it then misandrist to say that men are, on average, not as good at raising children? I wouldn't say so personally.

>My strong belief is that it's a problem of education and social pressures. Even in Romania (to be clear, I keep bringing it up because it's the country where I have the most experience), where women do choose these fields in much bigger numbers for whatever reasons, there are deep biases against women's ability in this field. Female colleagues were more likely to be a professor's target for ridicule, or simply receive lower grades on exams for the same mistakes. They would be less likely to be given as positive examples, and less likely to be encouraged towards this field.

I do trust what you say about this 100% when it pertains to Romania, but let me assure you that in the UK even a minor complaint of sexist harassment of any kind will very likely result in a rapid and unexpected vacancy in the company. Sometimes it can be even unfair, but that's besides the point again. In fact, in my experience whenever I see women in engineering fields, I'd see guys pretty much bend over backwards to be nice and supportive of them. So much so that it'd seem saccharine and the women would be either put off by this treatment(perhaps another pressure that dissuades women from the field? I doubt it but it could play a role I suppose, especially if the guys are doing it in the hopes of "surreptitiously" getting in their pants) or have everything so baby-proofed for them that they'd have no challenge because everything would be done for them.

>Even if comparing between two similar-income American (non-recent immigrants) families in the same city in America, one with black skin and the other with white skin, there is some SMALL chance that there are inherent biases, either internal or in the test, that may affect the validity of results. And from what I've read, many such comparisons are far, far from this close. Some famous books on the topic, such as "The Bell Curve", include horribly, obviously biased studies, such as comparing the IQs of white and black kids as measured by apartheid South Africa!

I agree that it can be an apples to oranges comparison. This conversation did make aware of how ignorant I was of the actual methodology of that IQ between races study, so that's something I'll have to look up. That "Bell Curve" thing is shocking! A good reminder how "science" can be manipulated by using a bad methodology to push results to confirm a bias and then touting it as the empirical truth. What I like to call the "I F**ING LOVE SCIENCE" brand of science.

Re: In Defense of Myers Briggs (2020)

#286
I've got a PhD in psychology. I have things. I. could. say. about this topic. But I would like to emphasize, in the strongest of terms, that Cronbach's alpha is not a measurement of test-retest reliability. Cronbach's alpha is a measure to answer the question, "If we ask five questions to measure the same thing, how well do they agree?" Test-retest reliability says, "If we ask these same questions X days/months/years later, how likely is it we'll get the same answer?"

Past research on this latter form of reliability (test-retest) on the MBTI have found it to be quite weak; yes, I'm sure it's probably more favourable if you don't binarize the measures. But it's still weak. If you're interested, the references on the "Reliability" section of the Wiki page[1] is a decent place to start.

My biggest issue with the MBTI, however, is that it gets used to make important decisions like whether to hire someone, despite little to no evidence for its validity in terms of predicting on-the-job performance. And that's extremely concerning. Quite frankly, personality tests have very little place in hiring assessments at all -- often the primary dimension employers care about is conscientiousness, and those questions are generally too transparent to be reliable for someone who has a vested interest in getting a job. Are you really going to report that you are "someone who tends to be disorganized" when you're trying to get hired?

If you're an employer looking for ways to find the best candidates, then you have a responsibility to ensure that the methods you're using to test someone's fit are a reliable indicator of their actual fit. Interpret "fit" how you like, but generally speaking, you want measures that are going to actually tell you how well that person will do with the tasks they would be performing. You're going to have much better luck with a take-home assignment or temporary contract than you will reading the tea leaves of MBTI, or even using an established, valid test like the Big Five Inventory. These measures just aren't meant for what you're trying to use them for.

[1] https://en.wikipedia.org/wiki/Myers%E2%80%93Briggs_Type_Indi...

Re: In Defense of Myers Briggs (2020)

#287
post #280

Earlier quoted context omitted.

How would the central limit theorem apply to seemingly bimodal distributions like left vs right handedness?

With respect to personality, I believe that there are likely a number of independent factors, perhaps hundreds, that affect in some way where one’s position lies on each of the axes of personality. These factors could be particular childhood traumas, birth order, parent’s behavior/addiction, childhood friends, and genetic factors. Even if each of these numerous random variable is binomial the central limit theorem ap…

This article [1] about what determines a persons handedness starts out:

> Like most aspects of human behavior, handedness is a complex trait that appears to be influenced by multiple factors, including genetics, environment, and chance.

It goes on to say that there are up to 40 genes that contribute. It seems like it's complex enough that the central limit theorem should apply yet handedness is definitely a bimodal distribution.

[1]: https://medlineplus.gov/genetics/understanding/traits/handed...

Re: In Defense of Myers Briggs (2020)

#288
post #48

Earlier quoted context omitted.

Would you please stop posting shallow dismissals and calling names in HN comments? Posts like this and https://news.ycombinator.com/item?id=26289644 are not what this site is for. https://news.ycombinator.com/newsguidelines.html Edit: we've had to ask you this sort of thing a ton of times. Eventually we ban such accounts. If you wouldn't mind reviewing the guidelines and taking the intended spirit of the site more to…

"we've had to ask you this sort of thing a ton of times. Eventually we ban such accounts" No you haven't. What's wrong with calling out bad products for what they are?

You replied to several of these at the time, but perhaps a refresher will be helpful:

https://news.ycombinator.com/item?id=23011040

https://news.ycombinator.com/item?id=22280026

https://news.ycombinator.com/item?id=17856086

https://news.ycombinator.com/item?id=17447722

https://news.ycombinator.com/item?id=17335152

https://news.ycombinator.com/item?id=17181868

https://news.ycombinator.com/item?id=16814032

https://news.ycombinator.com/item?id=16261030

https://news.ycombinator.com/item?id=16788897

The problem isn't "calling out bad products", though I wouldn't use the phrase "calling out", since the online callout/shaming culture is something we try to avoid here. Thoughtful critique is obviously welcome.

The problem is that you have a long history of breaking the site guidelines by posting flamebait and/or unsubstantive comments. If you can't or won't stop this, we will ban you, so please stop.

Re: In Defense of Myers Briggs (2020)

#289

Earlier quoted context omitted.

> 1. It's inaccurate. Reproducibility is most directly correlated against certain identifiers. For example no matter where or how I take a MB assessment I am always INTP. This indicates that for some persons, as associated to certain scored identifiers, this test is always reproducible. That is less a flaw in this test than the test subjects and further suggests MB becomes more valid when correlated with other tests…

Same here. I have taken the test multiple times throughout my life and I get INTP every single time. The description is completely accurate too, down to the individual nuances describing an INTP. It’s frighteningly accurate. I wonder if less common MBTI types are more accurately defined.

I get the same Hogwarts house every time I take that test too.

Re: In Defense of Myers Briggs (2020)

#290
post #14
post #10

An interesting thing about introversion/extroversion and testing: Assuming that I remember details right from a class I took over twenty years ago, taking caffeine before a test improves performance for introverts but not extroverts (unless I misremembered and it's the other way around). It's a remarkably strong result and one of the few strong results in experimental personality research.

What does "improve" mean on an introvert/extrovert test?

My wording was confusing: it would be on an unrelated skills test. I'm pretty sure it was introverts that improved because I remember thinking that I should make a point of getting some caffeine before future tests.
Post reply on HN