Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Rebuilding after the replication crisis

asteriskmag.com

Post reply on HN
Print view View original

71–76 of 76 posts

Re: Rebuilding after the replication crisis

#71

Post by Helmut10001 »

leereeves wrote: post #58
samus wrote: post #16

Earlier quoted context omitted.

If the study otherwise follows best practices, results about differences between well-defined subpopulations, and the reasons behind them, are still worthwhile to investigate and report.

If the relevant subpopulations are well-defined, then it should be possible to sample from those subpopulations and reproduce the results.

But then, for many studies about (e.g.) Eating, Behavior, Psychology (etc.): Even for well defined populations (lets say, "religious male adults in Texas") there would be so many incidental variables that I would have strong doubts that results are easily reproducible. On the other hand, studies with "well defined" but very narrow subpopulations (e.g. "religious male adults in Texas that work in printing offices and eat granola every morning") are not easily transferrable, which makes it difficult to generalize results (thus, results are less significant).

Re: Rebuilding after the replication crisis

#72

Post by 3pt14159 »

mhuffman wrote: post #69
3pt14159 wrote: post #48

Earlier quoted context omitted.

Not going to comment on psychology directly, because I don't know enough about it, but there are some fields where there really is no replication crisis. In structural engineering we literally tore metals apart to find their physical properties. Concrete was mixed. Giant crushing machines were used. Etc. Sometimes I think that half the reason why some fields don't have a replication crisis is because literal lives ar…

>Sometimes I think that half the reason why some fields don't have a replication crisis is because literal lives are on the line if you get it wrong, so people actually do the work to make the testing gear and align the incentives that need to be aligned. You don't think lives are on the line with psychology? The replication crisis there should be terrifying but because of the extra degree of separation between theor…

Yes, I think your way of phrasing it is more correct. Lives are on the line with psychology, but the feedback loop is usually broken.

Re: Rebuilding after the replication crisis

#73

Post by williamcotton »

krapp wrote: post #70
williamcotton wrote: post #65

Earlier quoted context omitted.

Really, the guy who was president of a club whose motto is “take no one’s word for it” would be fine with just like, taking someone’s word for it?

If that "someone" was the Bible, yes. Apart from his occult work (which like most Western magic was done in a heretical Christian context) he published numerous works on Biblical literalism and prophecy. That Newton considered his work primarily an expression of his religious views isn't exactly a secret. You made the mistake of reaching too far back in time, searching for an example of someone who should have been a…

You’ve taken the discussion into a discussion about religion and not just about “natural philosophy”, which is fine, but not what anyone is talking about with “believe in science”.

If we want to talk about religion and taking no one’s word for it you’ve already started us in this direction by pointing out his rejection of church orthodoxy, which is basically the extreme end of Protestant practice.

If you believe that God wrote the Bible and that the church is made up of corrupt men and that only your personal understanding of the word of God is the path towards the True, well, you’re completely at odds with the epistemology of the Catholic Church with regards to religion and very much primed to take the same approach of a personal relationship with God and his word to a personal relationship with natural philosophy.

Re: Rebuilding after the replication crisis

#74

Post by portpecos »

barry-cotter wrote: post #25
harles wrote: post #15

Earlier quoted context omitted.

Per her Wikipedia [0], she authored papers about the debunked power posing. > The theory is often cited as an example of the replication crisis in psychology, in which initially seductive theories cannot be replicated in follow-up experiments. [0]: https://en.m.wikipedia.org/wiki/Amy_Cuddy

And is still making money off of motivational speaking based on it.

This might explain Amy Cuddy better: https://en.wikipedia.org/wiki/Power_posing

Re: Rebuilding after the replication crisis

#75

Post by MichaelZuo »

mattkrause wrote: post #57
MichaelZuo wrote: post #50

Earlier quoted context omitted.

There's definitely no replication crisis in jet turbine design research also.

ahem https://retractionwatch.com/?s=turbine A lot of these appear to be cases of flat-out fraud or dubious research practices. These all get muddled together under the heading of "replication crisis" but I do think they're a bit of a different beast.

You linked to something about wind turbines.

Did you link to the wrong article?

Post reply on HN