Live data from Hacker News

Machine Learning Is the New Statistics

danielmiessler.com

1–10 of 33 posts

Re: Machine Learning Is the New Statistics

#3
While I'm not a fan of the modern abuse of the term "machine learning" as a marketing buzzword, this article is tautological ("Machine Learning is the new statistics because it is not statistics") and does not provide much insight aside from invoking other buzzwords ("Reality Analysis Level 1"?).

Re: Machine Learning Is the New Statistics

#4

Machine learning is subset of statistics. The standard text in ML, "The Elements of Statistical Learning" is authored by statistics Professors. Statistics is the new statistics. The rest is marketing bullshit.

Hmm. Maybe you're right.

But let me try to push back.

If we're trying to draw human-consumable wisdom about the state of the world from data, simply capturing a snapshot and then applying some basic analysis is one thing.

Creating self-improving mechanisms for doing this is another, even if the latter use statistics in the process. Perhaps in a similar way that Statistics uses Algebra yet is distinct in its description and capabilities.

I'm not convinced you're wrong here, just trying to talk through it.

Re: Machine Learning Is the New Statistics

#5

While I'm not a fan of the modern abuse of the term "machine learning" as a marketing buzzword, this article is tautological ("Machine Learning is the new statistics because it is not statistics") and does not provide much insight aside from invoking other buzzwords ("Reality Analysis Level 1"?).

The "insight" would be in the form of a falsifiable claim, i.e. that ML will be bigger than the advent of statistics in terms of its ability to improve our understanding of the world.

It's a claim, nothing more.

Re: Machine Learning Is the New Statistics

#7

Machine learning is subset of statistics. The standard text in ML, "The Elements of Statistical Learning" is authored by statistics Professors. Statistics is the new statistics. The rest is marketing bullshit.

Hmm. Maybe you're right. But let me try to push back. If we're trying to draw human-consumable wisdom about the state of the world from data, simply capturing a snapshot and then applying some basic analysis is one thing. Creating self-improving mechanisms for doing this is another, even if the latter use statistics in the process. Perhaps in a similar way that Statistics uses Algebra yet is distinct in its descripti…

I think that one of the problems I have with the description in the post is that it draws a line where, in reality, no real line (or at the very least, only a blurry mess) exists. For example, where do hierarchical models and Bayesian nonparametric models fit? Where does model selection fit? These notions have existed in statistics for some time. I'm not one of these particularly dogmatic people who believe that "it's all just statistics" or, conversely "machine learning is entirely new / different". In fact, I think it's the deep (and continuing) connection between these fields that make them both so interesting and powerful. However, I do tend to agree that the type of hype used in this post massively oversells ML while simultaneously underselling Stats, based, partly, on the false dichotomy drawn between them.

Re: Machine Learning Is the New Statistics

#8

Machine learning is subset of statistics. The standard text in ML, "The Elements of Statistical Learning" is authored by statistics Professors. Statistics is the new statistics. The rest is marketing bullshit.

Hmm. Maybe you're right. But let me try to push back. If we're trying to draw human-consumable wisdom about the state of the world from data, simply capturing a snapshot and then applying some basic analysis is one thing. Creating self-improving mechanisms for doing this is another, even if the latter use statistics in the process. Perhaps in a similar way that Statistics uses Algebra yet is distinct in its descripti…

[deleted]

Re: Machine Learning Is the New Statistics

#9

Machine learning is subset of statistics. The standard text in ML, "The Elements of Statistical Learning" is authored by statistics Professors. Statistics is the new statistics. The rest is marketing bullshit.

Hmm. Maybe you're right. But let me try to push back. If we're trying to draw human-consumable wisdom about the state of the world from data, simply capturing a snapshot and then applying some basic analysis is one thing. Creating self-improving mechanisms for doing this is another, even if the latter use statistics in the process. Perhaps in a similar way that Statistics uses Algebra yet is distinct in its descripti…

What the parent is saying is that machine learning is a buzzword for statistics or at best another word for applied statistics.

Saying that applied physics will be the new physics because it changes the real world, is nonsensical.

In earlier days Google called their translation algorithms statistical, then they changed it to ML and now AI has come in favour again, so that is the word being used.

Re: Machine Learning Is the New Statistics

#10
The statement "More wisdom potentially gets extracted when you apply Statistics to more (and better) data, but the analysis itself doesn’t improve with better data." simply isn't true. A hierarchical model, for example, is increasingly able to model subgroups and additional levels of hierarchy as more data are added. Penalized regression (or Bayesian regression) is another example -- the model is structurally different as you change the quantity of data.

The difference between ML and statistics is entirely semantic. Is logistic regression a ML method or a statistical method? It is both!

Post reply on HN