Live data from Hacker News

A bot crawled thousands of studies looking for simple math errors

vox.com

31–40 of 221 posts

Re: A bot crawled thousands of studies looking for simple math errors

#31

Earlier quoted context omitted.

It'd be easier for them to not obfuscate and use the checker themselves prior to publishing.

True, assuming no malfeasance on the part of the authors.

If you are trying to publish a fraudulent paper, you aren't going to do it by including subtle math errors to fudge your data in the direction you want. You would just falsify the data itself; way harder to find, and much more effective.

Re: A bot crawled thousands of studies looking for simple math errors

#32
post #27

Earlier quoted context omitted.

Objectivity is listed as a problem with science curriculum. Welcome to the future. http://nsuworks.nova.edu/cgi/viewcontent.cgi?article=2467&co...

This appears to be about STEM education, not STEM fields directly.

So STEM curriculum should teach there are no objective truths? 1 + 1 is not always 2? Failure to reproduce a study could just be the result of different cultural, gender, or racial differences in the researchers and does not necessarily invalidate anything?

Re: A bot crawled thousands of studies looking for simple math errors

#33
> There’s a big, uncomfortable question of how to criticize past work, and whether online critiques of past work constitute “bullying” or shaming.

Science is fundamentally reputation-driven. One of, if not the primary incentive that encourages scientists to do science work is the chance of raising their prestige. Citations are one very quantifiable yardstick for this.

If positive social sanctions are a driving force for science, then it's entirely reasonable that negative sanctions should come into play too. If you can well-cited paper and attract fame, then a poor paper should likewise attract shame.

Otherwise you have a positive feedback loop where once a scientist has attracted enough prestige, they are untouchable. We need negative feedback to balance that out.

Re: A bot crawled thousands of studies looking for simple math errors

#34
> and whether online critiques of past work constitute “bullying” or shaming. The PubPeer comments are just a tiny part of that debate. But it can hit a nerve.

> Susan Fiske, a former president of the Association for Psychological Science, alluded to Statcheck in an interview with Business Insider, calling it a “gotcha algorithm.”

> The draft of the article said these online critics were engaging in “methodological terrorism.”

If these are attitudes typical of psychology, then I cannot say I consider psychology to be a proper social science. There is a fundamental misunderstanding of how knowledge is created through the scientific process if the verification step is considered to be offensive or taboo. That anyone in the field of psychology would even be comfortable publically espousing a non-scientific worldview like that means that psychologists are not being properly educated in the scientific method and should not be in the business of producing research since they do not have a mature understanding of what "scientific" implies.

Re: A bot crawled thousands of studies looking for simple math errors

#35
post #34

> and whether online critiques of past work constitute “bullying” or shaming. The PubPeer comments are just a tiny part of that debate. But it can hit a nerve. > Susan Fiske, a former president of the Association for Psychological Science, alluded to Statcheck in an interview with Business Insider, calling it a “gotcha algorithm.” > The draft of the article said these online critics were engaging in “methodological t…

You left out this part:

> The gist of her article was that she feared too much of the criticism of past work had been ceded to social media, and that the criticism there is taking on an uncivil tone.

So it seems to me, her complaint was not that research shouldn't be criticized. It was more-so that research should be criticized well, and that social media is a poor place for it, because it favors personal attacks over thoughtful criticism. (I'm not saying I agree with her. Just trying to understand her argument in the best light.)

Re: A bot crawled thousands of studies looking for simple math errors

#36

I find it very disconcerting that people are trying to fend off criticism of previously published studies by calling it "bullying" or sometimes worse. What do feelings have to do with science?

Objectivity is listed as a problem with science curriculum. Welcome to the future. http://nsuworks.nova.edu/cgi/viewcontent.cgi?article=2467&co...

Relevant part of the report:

"As these examples show, the STEM syllabi explored in this study demonstrated a view of knowledge that was to be acquired by the student, which promotes a view of knowledge as unchanging. This is further reinforced by the use of adverbs to imply certainty such as “actually” and “in fact” which are used in syllabi to identify information as factual and beyond dispute (Biber, 2006a; 2006b). For example, “draw accurate conclusions from scientific data presented in different formats” (Lower level math). Instead of promoting the idea that knowledge is constructed by the student and dynamic, subject to change as it would in a more feminist view of knowledge, the syllabi reinforce the larger male-dominant view of knowledge as one that students acquire and use make the correct decision."

Re: A bot crawled thousands of studies looking for simple math errors

#38
post #34

> and whether online critiques of past work constitute “bullying” or shaming. The PubPeer comments are just a tiny part of that debate. But it can hit a nerve. > Susan Fiske, a former president of the Association for Psychological Science, alluded to Statcheck in an interview with Business Insider, calling it a “gotcha algorithm.” > The draft of the article said these online critics were engaging in “methodological t…

The last quote, which is the most extreme response, seems like it's not entirely within the same context as the article. I got that it was talking about _human_ online critics, and especially (only?) those who have an "uncivil tone", which is something I agree with.

Re: A bot crawled thousands of studies looking for simple math errors

#39
post #23

I find it very disconcerting that people are trying to fend off criticism of previously published studies by calling it "bullying" or sometimes worse. What do feelings have to do with science?

I guess I can accuse my compiler of bullying me.

I've been saying that for years!!!

Re: A bot crawled thousands of studies looking for simple math errors

#40

Earlier quoted context omitted.

Objectivity is listed as a problem with science curriculum. Welcome to the future. http://nsuworks.nova.edu/cgi/viewcontent.cgi?article=2467&co...

While I am not a big fan of contemporary feminism, I am pretty sure taking issue with masculinity or "gendered" text is not the same thing as taking issue with objectivity. Edit: Found this quote in your source "Poststructuralism “rejects objectivity and the notions of an absolute truth and single reality,”" Hmm, this seems an awful lot like a religion.

> I am pretty sure taking issue with masculinity or "gendered" text is not the same thing as taking issue with objectivity.

Well, since English is a gendered language, taking issue with 'gendered' text is taking issue with the objective reality that … English is a gendered language.

Post reply on HN