Live data from Hacker News

Why don't machine learning research agents overfit?

amazon.science

11–20 of 72 posts

Re: Why don't machine learning research agents overfit?

#12
post #2

> Machine learning, at its core, is about generalization, not memorization. Well they memorize the patterns. memorization doesnt mean rote learning.

I don't take issue with that. Attempting memorized pattern generalization through holdout / validation strategies is a big part of ML that you would not typically see with econometrics / psychometrics / possibly sabermetrics / most other -metrics. Philosophically the explain versus predict divide. https://www.stat.berkeley.edu/~aldous/157/Papers/shmueli.pdf

Re: Why don't machine learning research agents overfit?

#13
post #8

I always get annoyed when people misinterpret Occam’s razor. It’s not that the simplest is more likely to be correct, it’s that you should prefer it, because it’s simple. It’s just like the Hopper quote. She said it’s better to ask for forgiveness during the fog of war, doing something you thought was right, not to do something you knew they were going to say no to and now you are trying to get away with something.

That's not true. It's pretty clear that she meant "do something you knew they were going to say no to and now you are trying to get away with something."

https://youtu.be/wHdHCoeUbU4?t=861s

> So I want to tell something to all the young people here on many many occasions you'll find it is much easier to apologize than it is to get permission. You do it then when somebody comes after you and say are you supposed to do that, "oh gee I didn't know I wasn't supposed to do that" ... so just remember it's frequently much easier to apologize than it is to get permission do it

She goes on further, explaining how to deceive your superiors to manipulate them to get what you want.

Re: Why don't machine learning research agents overfit?

#14
post #3

Even tech giants are putting out articles seemingly fully written by Claude.

Time to first detected slop in this article is Is it too much to ask from people to read their own article anymore?

If anyone read this at all, they would have had the ick, and would have fired off a prompt to get rid of the most popular AI slop tells...

Re: Why don't machine learning research agents overfit?

#16
post #4
post #3

Even tech giants are putting out articles seemingly fully written by Claude.

The animated graphic labeled "Occam's razor, formalized" is bizarre. Is that really visualizing "Occam's razor, formalized"?

I was expecting Occam wearing a suit.

Re: Why don't machine learning research agents overfit?

#18
post #3

Even tech giants are putting out articles seemingly fully written by Claude.

Time to first detected slop in this article is Is it too much to ask from people to read their own article anymore? If anyone read this at all, they would have had the ick, and would have fired off a prompt to get rid of the most popular AI slop tells...

What I really dislike is having to edit my own non-LLM assisted writing to make sure I'm not accidentally confused with AI.

I caught myself writing "And that matters because..." in a HN comment but had to edit myself. Also miss uising emdashes.

Re: Why don't machine learning research agents overfit?

#19
post #8

I always get annoyed when people misinterpret Occam’s razor. It’s not that the simplest is more likely to be correct, it’s that you should prefer it, because it’s simple. It’s just like the Hopper quote. She said it’s better to ask for forgiveness during the fog of war, doing something you thought was right, not to do something you knew they were going to say no to and now you are trying to get away with something.

>It’s just like the Hopper quote.

Not sure about Hopper, as I recall biographers of Lawrence of Arabia certainly made it seem like he was using the fog of war to do things he knew his superiors may object to.

Regardless, even if its misinterpreted it still has a kernal of truth and separate utility than your version, that is: the people in the field closest to the action have an operational awareness that may result in better decisions in times of urgency.

Re: Why don't machine learning research agents overfit?

#20
post #13
post #8

I always get annoyed when people misinterpret Occam’s razor. It’s not that the simplest is more likely to be correct, it’s that you should prefer it, because it’s simple. It’s just like the Hopper quote. She said it’s better to ask for forgiveness during the fog of war, doing something you thought was right, not to do something you knew they were going to say no to and now you are trying to get away with something.

That's not true. It's pretty clear that she meant "do something you knew they were going to say no to and now you are trying to get away with something." https://youtu.be/wHdHCoeUbU4?t=861s > So I want to tell something to all the young people here on many many occasions you'll find it is much easier to apologize than it is to get permission. You do it then when somebody comes after you and say are you supposed to do…

Damn no wonder she got a supercomputer named after her
Post reply on HN