This image is the best illustration of the flaw https://arxiv.org/html/2402.14583v1/x1.png
On mobile and can’t read the rest of the paper, the impact could be massive.
Seaborn bug responsible for finding of declining disruptiveness in science
11–20 of 77 posts
Re: Seaborn bug responsible for finding of declining disruptiveness in science
#12The graphing library caused this?
No, bad analysis caused it. Graphs are at best secondary tools to interpret findings. You don't use graphs to draw conclusions.
Re: Seaborn bug responsible for finding of declining disruptiveness in science
#13Seaborn is a visualization library. No statistical tests should have been done with seaborn as an intermediate processing step. I guess they used some of the convenience functions as part of the data analysis. Seaborn is a final step tool, not a data analysis tool. That's an embarrassing lesson to learn post-publication.
Re: Seaborn bug responsible for finding of declining disruptiveness in science
#14The graphing library caused this?
I must be waking up still because on first reading I interpreted it as a sea-born bug, something infectious or parasitic.
Re: Seaborn bug responsible for finding of declining disruptiveness in science
#15Reading the comments here hilarious.
Like others, expecting a wildy different article...
Re: Seaborn bug responsible for finding of declining disruptiveness in science
#16Sounds like a plot point from three body problem.
Re: Seaborn bug responsible for finding of declining disruptiveness in science
#17Seaborn is a visualization library. No statistical tests should have been done with seaborn as an intermediate processing step. I guess they used some of the convenience functions as part of the data analysis. Seaborn is a final step tool, not a data analysis tool. That's an embarrassing lesson to learn post-publication.
Take a look at the linked chart in my other comment. Visualization is absolutely a driver during research, it isn’t just an embarrassing revelation. Charts killed the Challenger crew.
Re: Seaborn bug responsible for finding of declining disruptiveness in science
#18Seaborn??? Typo surely Edit: Not mentioned in the abstract but it is in the main paper. Editorialised title.
It's referring to the seaborn library ( https://seaborn.pydata.org/ ), a Python library for data visualization (built on top of matplotlib).
The first word of an editorialised title, frowned upon here, and not mentioned in the abstract (which I did read)
Re: Seaborn bug responsible for finding of declining disruptiveness in science
#19Bizarre. How do people make such big, splashy findings that can mess with people’s sense of optimism about science and innovation, without doing the simplest types of checks on their data and methodology.
It’s enough to make you lose faith in science.