Live data from Hacker News

Evidence of inconsistencies in evaluation process and selection of winners

kaggle.com

51–60 of 338 posts

Re: Evidence of inconsistencies in evaluation process and selection of winners

#51
post #14

Sadly, the major ML/AI/NLP conferences are being inundated with AI slop papers. That will arguably have a bigger impact on the quality of research moving forward.

" impact on the quality of research moving forward. " It'll affect everything that depends on manipulating symbols! The enormous body of knowledge humanity has accumulated over the past 6.000 years or so is about to be flooded with slop!And That's the real threat genai poses to humans that i don't see anyone talking about..

Re: Evidence of inconsistencies in evaluation process and selection of winners

#52

AI is useful. But the amount of people that are simply offloading all of their thinking to AI and blindly accepting the answer is absurd. Kaggle is most likely using ai to assess the submissions and are not using any common sense by blindly accepting the results.

I think we need to address the underlying causes of people outsourcing their thinking like that. And a big contribution is “move fast.” No one has time to read, process, and think, because The Powers That Be (capital) want their results now.

Pragmatically speaking, a half-assed answer now, is often better than a perfect answer tomorrow.

Re: Evidence of inconsistencies in evaluation process and selection of winners

#54

AI is useful. But the amount of people that are simply offloading all of their thinking to AI and blindly accepting the answer is absurd. Kaggle is most likely using ai to assess the submissions and are not using any common sense by blindly accepting the results.

I think we need to address the underlying causes of people outsourcing their thinking like that. And a big contribution is “move fast.” No one has time to read, process, and think, because The Powers That Be (capital) want their results now.

I just shame people that give slop.

Slop PR? Fix the slop.

Slop design? I’m not implementing slop, fix it.

Innundated with slop PRs? Send half of them to my super and tell him to deal with it.

We’ve fired people that wouldn’t get their shit together.

Deadlines are being missed because we need to spend more time fixing slop? That’s a planning (management) problem, not mine. Management are the ones that forced everyone to write all code with AI now they are grtting what they asked for. I don’t care what date you promised the customer with absolutely no data to back it up that isn’t my problem.

I’m grateful I’m in a position to be able to do this but the way to deal with slop is zero tolerance. Be as ruthless as a Terminator. Though you will need to grow a backbone and stand your ground or it will break you.

Things don’t change unless the people that make the decisions actually feel the pain.

Re: Evidence of inconsistencies in evaluation process and selection of winners

#55
post #24

Earlier quoted context omitted.

AI is extremely useful, we just haven’t zeroed in on your specific use cases yet. Robotics has been transformed by it, IT and tech has been transformed by it. Finance and Legal have been transformed by it. To say it’s 95% useless is a personal bias. To me it’s 65% useful. As it can run in the background doing “chores” while I sleep.

Your perspective is a short arc. “Look what I can do now and look it made me way more productive.” I have no doubt it is true, you are on the up right now. However thinking of the long arc is important to, even though it has no consequence for you right now. AI is a force multiplayer and scarily dangerous in the wrong hands. We can already see by these discussions how uncertain things are. Just food for thought.

Yes, if the Cro-Magnons had guns they’d say “wow, hunting meat is WAY easier” and then experience massive-scale death in the future. But that kinda happened anyway in various places, just using much more primitive tools. Humans gonna human.

Re: Evidence of inconsistencies in evaluation process and selection of winners

#56
post #23

Earlier quoted context omitted.

AI is extremely useful, we just haven’t zeroed in on your specific use cases yet. Robotics has been transformed by it, IT and tech has been transformed by it. Finance and Legal have been transformed by it. To say it’s 95% useless is a personal bias. To me it’s 65% useful. As it can run in the background doing “chores” while I sleep.

People's workday has been transformed by it. But I fail to see actual transformation beyond "more crap, faster." AI hasn't done anything we couldn't already do. It's just doing it faster and with more mistakes.

> AI hasn't done anything we couldn't already do. It's just doing it faster and with more mistakes.

You forgot CHEAPER (at least now, burning VC money), which is a major motivating factor.

Re: Evidence of inconsistencies in evaluation process and selection of winners

#57

AI is useful. But the amount of people that are simply offloading all of their thinking to AI and blindly accepting the answer is absurd. Kaggle is most likely using ai to assess the submissions and are not using any common sense by blindly accepting the results.

I think we need to address the underlying causes of people outsourcing their thinking like that. And a big contribution is “move fast.” No one has time to read, process, and think, because The Powers That Be (capital) want their results now.

There is also the "You aren't paid to think, you are paid to do exactly what I tell you, nothing more or less!" school of management. I'm not sure how prevalent this attitude is now but it was very common in the 90s and 2000s. The AI and the bosses that want you to use it all speak from positions of authority and confidence. That's their right, granted to them by their position. You don't speak that way because as a subordinate if you do so it's an act of insubordination or disfealty and you need to be reminded of your place. So you learn to stay in your lane, mind your own business, etc etc because rule number one is that the nail that sticks up gets beaten down. ("He who has the money makes the rules" is rule number zero.)

Re: Evidence of inconsistencies in evaluation process and selection of winners

#58
post #23

Earlier quoted context omitted.

People's workday has been transformed by it. But I fail to see actual transformation beyond "more crap, faster." AI hasn't done anything we couldn't already do. It's just doing it faster and with more mistakes.

That just isn’t true. AI is capable of performing a lot of grunt work reliably. Still must be reviewed. But a big productivity gain over doing everything yourself.

While I agree with you in principle, I think the parent has a point here: where's the amazing product that couldn't have been done without AI? By now we should have seen some major new invention/company, incredibly fast revolutionary feature rollouts etc but I'm just seeing more of the same.

Re: Evidence of inconsistencies in evaluation process and selection of winners

#59
post #24

Earlier quoted context omitted.

AI is extremely useful, we just haven’t zeroed in on your specific use cases yet. Robotics has been transformed by it, IT and tech has been transformed by it. Finance and Legal have been transformed by it. To say it’s 95% useless is a personal bias. To me it’s 65% useful. As it can run in the background doing “chores” while I sleep.

Your perspective is a short arc. “Look what I can do now and look it made me way more productive.” I have no doubt it is true, you are on the up right now. However thinking of the long arc is important to, even though it has no consequence for you right now. AI is a force multiplayer and scarily dangerous in the wrong hands. We can already see by these discussions how uncertain things are. Just food for thought.

> AI is a force multiplayer and scarily dangerous in the wrong hands

You have to spell this out a lot more if you want to have credibility.

I’m not seeing anything in discussed here that seems scary.

Re: Evidence of inconsistencies in evaluation process and selection of winners

#60
post #33
post #28

Earlier quoted context omitted.

But is it load-bearing?

I thought it was a belt and suspenders conclusion

This is one of the things that upsets me the most about LLM writing. “Load bearing” and “belt and suspenders” are two tropes I’ve used for a long, long time and now I have to be intentional about not using them lest I be accused of offloading my writing.
Post reply on HN