Science is a strong-link problem
experimental-history.com
Science is a strong-link problem
1–10 of 14 posts
Re: Science is a strong-link problem
#2I read this and thought, I wonder where LLM's fall in the range...I think about the quality of LLM's more than I want.
Re: Science is a strong-link problem
#3One purpose of science is to provide the rest of the society, who are not scientists, with reliable insights, ideally with actionable advice on how to solve a problem. If you treat science purely as a stong-link problem, the burden of quality control lays with the consumer of science. Peer review attempts to lay it with experts. That approach is nowhere near perfect, but is the best we have. And it scales much better.
Re: Science is a strong-link problem
#4I like the weak-link/strong-link distinction, but you need to be careful what problem exactly you are talking about. "Science" is not a problem. "How to distribute funding to scientists" is a problem. And here the weakest links actually matter, because you only have a finite amount of funding, and you don't want to waste it on the weak scientists, so you have more for strong scientists.
Another way of phrasing that problem is, "what actually is strong science, and what is weak science"? Over a few decades, that question usually plays out correctly, but even a few years is often not enough to tell, even for specialists, especially for truly new and original science. As an example, right now, would you say abstraction logic [1] is strong or weak science?
And of course, venture capital funding is also not a strong-link problem. You can waste money on some weak startups that you thought were actually strong, but do that too much, and your fund goes under.
Re: Science is a strong-link problem
#5Further discussion: https://news.ycombinator.com/item?id=41993801
Re: Science is a strong-link problem
#6[deleted]
Re: Science is a strong-link problem
#7I work as a scientist. I'm not sure I agree science is a strong-link problem. Rather, it contains both strong- and weak-link problems.
A lot of science work consist of what my scientist mother calls "bread work" - validation of existing techniques, building a general corpus of knowledge, maintaining databases with useful information and so on. These is weak-link work. A bad quality database will undermine any research which is built on it and not aware of its limitations.
A good recent example may be the stem cell research field, which was (and perhaps still is?) bogged down by being built on bad fundamentals.
But yes, more broadly speaking I do agree that science funding should be built to encourage more risk of failure, more elitism, and more consolidation of large project to be able to "punch through".
Re: Science is a strong-link problem
#8One purpose of science is to provide the rest of the society, who are not scientists, with reliable insights, ideally with actionable advice on how to solve a problem. If you treat science purely as a stong-link problem, the burden of quality control lays with the consumer of science. Peer review attempts to lay it with experts. That approach is nowhere near perfect, but is the best we have. And it scales much better…
Peer review is more table stakes to the expert conversation. A non-expert is still not particularly well equipped to evaluate peer-reviewed papers and synthesize a conclusion from them, you still will need an expert to boil it down to a lay-interpretable conclusion.
Re: Science is a strong-link problem
#9For all we talk about "learning" being the purpose of a college education, the true purpose for students is accreditation: to get a degree to get a job. Take away the degree and very few people will attend college.
This article (and the few P&T committees I've sat in on) makes it sound like faculty have created the same environment for themselves. "Just publish something" so you can have numbers on the board, so you can promote. Remove publishing requirements for tenure and I'm guessing the volume will drop off precipitously. Journals are accreditors for tenured positions the same way colleges are accreditors for the labor market. (Or so it seems to me!)
Re: Science is a strong-link problem
#10"When you’re looking to find a doctor for a routine procedure, you’re in a weak-link problem."
The supplies to scientific research as well.
Scientific publication does not have the gatekeeping that medical industry does to ensure that routine doctors can do most routine procedures without harm.
The gatekeepers of modern "Science" are explicitly harmful to novel insights. "Science advances one gravestone at a time" is not a new observation