Live data from Hacker News

To Fix the Social Sciences, Look to the “Dark Ages” of Medicine

thereader.mitpress.mit.edu

21–30 of 71 posts

Re: To Fix the Social Sciences, Look to the “Dark Ages” of Medicine

#21

This is the key flaw in this article: “The truth is that such questions are open to empirical study and it is possible for social science to study them scientifically.” Here is someone proclaiming to be a scientist, and then throwing out proclamations of ‘truth’ not backed by evidence. Goedel proved logically that any axiomatic system of information exchange can have truths that are not provable. It’s possible human…

He proved arithmetic is independent of logic. Geometry isn't.

Re: To Fix the Social Sciences, Look to the “Dark Ages” of Medicine

#22

I'm always amazed that someone who by all rights should be intimately familiar with the history of social science research like McIntyre can seemingly be so unaware of it. There was an empirical, modernist period in social sciences in the 40-80s of exactly the kind suggested by Lee and it was an absolute disaster. The results couldn't be related to the real world, and no one was really able to get over the inherent […

> The results couldn't be related to the real world, and no one was really able to get over the inherent [1] influence of the author in the data.

Wait. Do I understand you correctly that an objective approach failed and your conclusion is to be more subjective?

Re: To Fix the Social Sciences, Look to the “Dark Ages” of Medicine

#23
I've always found it uneasy that much of the data in social science studies comprise 5-point scale answers by volunteers to questionnaires, or observations of microcosmic situations that do not really represent reality (e.g. attempting to prove a hypothesis about generosity by giving participants $20 each and observing how they spend/gift it under a specially designed situation).

I wonder whether questionnaires should be replaced by more objective metrics, such as heart rate, pupil dilation, blood hormone levels, EEGs of the participants.

The other problem I see is the lack of predictive models in the social sciences, especially psychology. The type of models we have today are akin to 'celestial spheres' in ancient physics and the boiler theory of fever in medieval medicine (which led to blood-letting).

Re: To Fix the Social Sciences, Look to the “Dark Ages” of Medicine

#24
post #23

I've always found it uneasy that much of the data in social science studies comprise 5-point scale answers by volunteers to questionnaires, or observations of microcosmic situations that do not really represent reality (e.g. attempting to prove a hypothesis about generosity by giving participants $20 each and observing how they spend/gift it under a specially designed situation). I wonder whether questionnaires shoul…

Likert scale is the term of art

Re: To Fix the Social Sciences, Look to the “Dark Ages” of Medicine

#25
This article conflates all research in the "social sciences", when in fact methodological practices vary widely within disciplines and sub-disciplines. Within each field, there is a "qualitative" literature, much less successful and popular than it once was, and probably not very useful, although I like some ethnographic and anthropoligical studies. Mainstream economics and political science is incredibly mathematically sophisticated, in fact people are coming around to the idea that there may have been too much emphasis on quantitative gymnastics above things like formulating simpler hypotheses or more descriptive work. Sociology has a bit of both. Psychology was the main culprit in the replication crisis, but even the behavioural psychology work cited approvingly in the article (Kahneman) is, I think, somewhat speculative in relating its hypotheses to experiment.

Without doubt, in economics and political science at least the problem is that the research questions are infinitely more complex than in 19C medicine; not that the methods are not quantitatively rigorous. The questions are obviously also of a more normative and moral nature than in medicine.

Re: To Fix the Social Sciences, Look to the “Dark Ages” of Medicine

#26

I'm always amazed that someone who by all rights should be intimately familiar with the history of social science research like McIntyre can seemingly be so unaware of it. There was an empirical, modernist period in social sciences in the 40-80s of exactly the kind suggested by Lee and it was an absolute disaster. The results couldn't be related to the real world, and no one was really able to get over the inherent […

> After a lot of arguing and furious paper writing in the late 80s-90s, everyone began working on how to deal with that bias, moving it front and center where it can be handled instead of subtly hiding it in a bunch of numbers and pretending it didn't exist. And the result of that is... what exactly?

Vastly improved methodology and understanding of results. One of the issues of modernist research was that objective data was trash, but no one knew it. For instance, anthropologists would throw out / fail to collect artifacts that weren't usable with the analyses available at the time. You can't recover that from a table that says 50 bone shards were found in a pit. You can begin to recover that if the researcher flat out says they don't believe small bones are useful for the easily (an ideological position). Or, to use the example I gave earlier, if both a white male researcher and a female Afghani researcher studied menstruation in Kabul, they very well might get different results without any deficiencies in methodology by either. You can start to explain that if the researchers both flat out state their approaches and assumptions in interacting with their female subjects. Doing that requires us to understand that the researcher affects the results though, which is a fundamentally different view than standard empiricism.

Re: To Fix the Social Sciences, Look to the “Dark Ages” of Medicine

#27
post #22

I'm always amazed that someone who by all rights should be intimately familiar with the history of social science research like McIntyre can seemingly be so unaware of it. There was an empirical, modernist period in social sciences in the 40-80s of exactly the kind suggested by Lee and it was an absolute disaster. The results couldn't be related to the real world, and no one was really able to get over the inherent […

> The results couldn't be related to the real world, and no one was really able to get over the inherent [1] influence of the author in the data. Wait. Do I understand you correctly that an objective approach failed and your conclusion is to be more subjective?

The "objective" approach was never actually objective. It had just as many biases and issues as everything after it, but everyone sort of pretended it didn't. The change was recognizing that the same data wasn't objective and that researchers couldn't make it so. Instead, theory shifted to analyzing those inherent biases and studying how they affected research.

Re: To Fix the Social Sciences, Look to the “Dark Ages” of Medicine

#28
post #22

Earlier quoted context omitted.

> The results couldn't be related to the real world, and no one was really able to get over the inherent [1] influence of the author in the data. Wait. Do I understand you correctly that an objective approach failed and your conclusion is to be more subjective?

The "objective" approach was never actually objective. It had just as many biases and issues as everything after it, but everyone sort of pretended it didn't. The change was recognizing that the same data wasn't objective and that researchers couldn't make it so. Instead, theory shifted to analyzing those inherent biases and studying how they affected research.

If your data is not good enough, get better data. Don't abandon objectivity. I think this is why a lot of people don't take the social sciences seriously, there's an extreme resistance to just doing objective, data driven research (and the lack of reproducibility that comes with that).

Re: To Fix the Social Sciences, Look to the “Dark Ages” of Medicine

#29

The social scientists do everything for grant money. Foundations don't give grant money to figure out the truth. They get grant money to get someone to make some scientific sounding propaganda that supports whatever narrative they're pushing. Who comes up with the narrative to push though, and why?

>The social scientists do everything for Grant money.

That's a very absolute statement. The social scientists do everything for Grant money. Do you have some sort of data to back that up? I mean in a way it is true that research can only be conducted if there is Grant money but that should be true for all of the sciences.

>Foundations don't give grant money to figure out the truth. They get grant money to get someone to make some scientific sounding propaganda that supports whatever narrative they're pushing.

This might be true sometimes but do you think it is true for the majority of research? Not all foundations even have a "narrative" as far as I can tell.

>Who comes up with the narrative to push though, and why?

Isn't that a weirdly open question to ask at the end of a very assertive statement?

Re: To Fix the Social Sciences, Look to the “Dark Ages” of Medicine

#30
post #22

Earlier quoted context omitted.

> The results couldn't be related to the real world, and no one was really able to get over the inherent [1] influence of the author in the data. Wait. Do I understand you correctly that an objective approach failed and your conclusion is to be more subjective?

The "objective" approach was never actually objective. It had just as many biases and issues as everything after it, but everyone sort of pretended it didn't. The change was recognizing that the same data wasn't objective and that researchers couldn't make it so. Instead, theory shifted to analyzing those inherent biases and studying how they affected research.

> The change was recognizing that the same data wasn't objective and that researchers couldn't make it so. Instead, theory shifted to analyzing those inherent biases and studying how they affected research.

And yet, the best tools for this are underfunded or ignored: replication and publishing negative results.

Post reply on HN