Earlier quoted context omitted.
> All research and code posted on them gets a quick once-over; good work gets the attention it deserves; bad work is quickly ignored. What is the basis for all these claims? Who is giving it the quick once-over? Crowd-sourced review and information, despite some strengths and high initial hopes, has a record of extraordinary misinformation and disinformation. Why would we want to use that system for scientific resear…
The problem is that careful (conference) reviews don’t scale. Large conferences end up suffering from a highly stochastic behavior where excellent work is borderline rejected on a regular basis while mediocre/incorrect work gets accepted every so often. github/arxiv are no silver bullet but offer an interesting alternative (with their own set of challenges, though).
That doesn't mean we shouldn't look for improvements, of course.