Live data from Hacker News

A Dishonest, Indifferent, and Toxic Culture

huixiangvoice.medium.com

11–20 of 196 posts

Re: A Dishonest, Indifferent, and Toxic Culture

#11
I'm gonna get enemies for that ....

But let's face it: the Academia peer review process is pretty rotten.

- Many organisations could not care less about whatever crap you publish as long as you publish. And if possible a lot.

- Many journal's reviewers are friend of friends and you can often easily guess their names, even in double blinded review.

- Many reviewers care more about you quoting their own paper than giving any relevant feedback.

- There is plenty "pay2publish" journals that care about quantity not quality that are commonly used by academia to "force" validate crappy researches/PHds

- The publishing world is full of oversized-ego individuals that will destroy a paper just because it comes from a competing lab/department/professor and not because it is scientifically irrelevant.

And that is only a little subset of the problems...

Re: A Dishonest, Indifferent, and Toxic Culture

#12
post #5

The paper is "3D-based video recognition acceleration by leveraging temporal locality". Haven't found a copy online. I'd expect a paper like that to come with examples and a link to Github. Why fake something like that? Either the paper is ignored, or someone implements it and finds it doesn't work.

> I'd expect a paper like that to come with examples and a link to Github

You'd expect that, but you'd probably be surprised in a lot of cases. One of the strong reasons why good conferences mandate code nowadays. The quality of the code, and whether it actually reproduces what you claim, isn't checked systematically though. That's down to the reviewers' enthusiasm, and whether they actually have the technical means to reproduce. That's not a given for more niche robotics or high-profile AI applications where hardware can be an issue.

Re: A Dishonest, Indifferent, and Toxic Culture

#14

Sad story. An interesting question is if you were him, what to do? My intuitive thought is simply to quit, and start another academic pursuit (assuming you are really interesting in science and research); it could be rather hard, but that is life. LIFE never goes easy.

it's difficult to do unless you put yourself in that person's shoes. Basically forced to lie or be disgraced

Re: A Dishonest, Indifferent, and Toxic Culture

#15
post #5

The paper is "3D-based video recognition acceleration by leveraging temporal locality". Haven't found a copy online. I'd expect a paper like that to come with examples and a link to Github. Why fake something like that? Either the paper is ignored, or someone implements it and finds it doesn't work.

> Why fake something like that? Either the paper is ignored, or someone implements it and finds it doesn't work.

The "formal" academic world does not care one bit about stuff working or not. It's all about self-promotion, papers and meaningless academic rituals and procedures.

(And it's even worse outside of the US let me put it that way)

Re: A Dishonest, Indifferent, and Toxic Culture

#17
post #5

The paper is "3D-based video recognition acceleration by leveraging temporal locality". Haven't found a copy online. I'd expect a paper like that to come with examples and a link to Github. Why fake something like that? Either the paper is ignored, or someone implements it and finds it doesn't work.

As someone with a little experience in ML research, I feel like outside of the top 5-10 conferences, there rarely is a code repo [1]. I think an even bigger issue is that even when a repo is provided, it's often poorly documented, contains dead links, or _hard to reproduce on other machines_ without code-wrangling.

Tangentially related, even popular repos can have implementations of models that differ from the paper cited. So, who knows how far errors can propagate ¯\_(ツ)_/¯

[1] - https://www.guide2research.com/topconf/

Re: A Dishonest, Indifferent, and Toxic Culture

#18
post #11

I'm gonna get enemies for that .... But let's face it: the Academia peer review process is pretty rotten. - Many organisations could not care less about whatever crap you publish as long as you publish. And if possible a lot. - Many journal's reviewers are friend of friends and you can often easily guess their names, even in double blinded review. - Many reviewers care more about you quoting their own paper than givi…

Oh sure, the system is bad; it has perverse incentives and insufficient checks. But that doesn't also mean that these specific actors aren't more specifically bad in very concrete, condemnable ways.

Re: A Dishonest, Indifferent, and Toxic Culture

#19
I want to express sympathies in a particular way:

When I had a job I didn’t want, in a city i didn’t want, no kids, no wife, and prospects abounding, it was easy to speak truth to power. I did it, and I was right technically, businesswise, and morally. What a win...(?)

Now, I have my dream job, my dream location, my own damn house, and my family. -Whole thing feels like a dream I might wake up from if I am not careful... and I feel totally weighed down when it comes to speaking up in a way I would have never countenanced a few years ago.

All that to say, this poor kid... I can only imagine the incentive structures that led him to choose this route, but I know academia being f’ed is a big part of it, and it ticks me off.

Re: A Dishonest, Indifferent, and Toxic Culture

#20
post #11

I'm gonna get enemies for that .... But let's face it: the Academia peer review process is pretty rotten. - Many organisations could not care less about whatever crap you publish as long as you publish. And if possible a lot. - Many journal's reviewers are friend of friends and you can often easily guess their names, even in double blinded review. - Many reviewers care more about you quoting their own paper than givi…

> - Many reviewers care more about you quoting their own paper than giving any relevant feedback.

My supervisor once told me that I should quote a paper from a pair of reviewers (he knew exactly who was reviewing the papers) before he'd allow publishing. It was a CS paper and the reviewers were in the field of geology.

A few of those fun cases were the reason why I left the academia - corporate bs doesn't come close to academic bs.

Post reply on HN