Live data from Hacker News

Deep-Fried Data

idlewords.com

1–10 of 149 posts

Re: Deep-Fried Data

#2
"...Dim witted grad student that you can't really trust..."

Reminds me of the phrase "graduate student descent" for training neural networks...

I've been noticing more casual dismissiveness towards grad students lately. They are certainly often treated as the grunt laborers of academia, in areas where career prospects are downright stupid. I generally feel it would be more productive to at least pretend that they're being trained to be independent, aggressive researchers in their own right, though.

Re: Deep-Fried Data

#3
"The names keep changing—it used to be unsupervised learning, now it’s called big data or deep learning or AI"

Um, I'm sorry, but unsupervised learning and deep learning are not the same.

Re: Deep-Fried Data

#4
post #2

"...Dim witted grad student that you can't really trust..." Reminds me of the phrase "graduate student descent" for training neural networks... I've been noticing more casual dismissiveness towards grad students lately. They are certainly often treated as the grunt laborers of academia, in areas where career prospects are downright stupid. I generally feel it would be more productive to at least pretend that they're…

[deleted]

Re: Deep-Fried Data

#5
post #3

"The names keep changing—it used to be unsupervised learning, now it’s called big data or deep learning or AI" Um, I'm sorry, but unsupervised learning and deep learning are not the same.

What's the distinction?

Re: Deep-Fried Data

#6
I provide guidance to attorneys involved in the discovery process; "Technology Assisted Review" is of huge interest to those teams, as it allows them to leverage coding on a small sample of the population across a much larger set of documents. For many cases, the cost and (occasional) time savings is instantly attractive. Sadly, the process is hard to do well. Far too many screw it up in new and amazing ways.

The author's concerns over machine learning are well-founded. The best option I've been able to identify to ameliorate some of the concerns is focusing on the population that will be suppressed. Once the model returns the desired recall / precision, drawing samples from the excluded population with a rigorous acceptance standard can help validate whether you've simply built a model around your biases. Couple that with allowing an opponent to validate a randomly-selected sample and you've cleared up a lot of the uncertainty in the model.

It's not perfection, but perfection is a very difficult standard.

Re: Deep-Fried Data

#7
post #3

"The names keep changing—it used to be unsupervised learning, now it’s called big data or deep learning or AI" Um, I'm sorry, but unsupervised learning and deep learning are not the same.

What's the distinction?

Unsupervised refers to whether or not the dataset is being trained against anything. Think about the difference between: How many people will view this webpage? Divide these pages into 20 clusters? The first is supervised. The second isn't.

Deep learning refers to a particular type of a particular learning technique: Specifically a neural network that has many hidden (intermediate) layers. Deep learning can be used for either supervised or unsupervised learning.

Re: Deep-Fried Data

#9
post #8

Rather hilariously, deep frying is already a term of art in ML, of course in a radically different setting. Deep fried convnets ( https://arxiv.org/abs/1412.7149 ).

One (not especially widely read) paper's title can hardly be called a "term of art" in ML.

Re: Deep-Fried Data

#10

Earlier quoted context omitted.

What's the distinction?

Unsupervised refers to whether or not the dataset is being trained against anything. Think about the difference between: How many people will view this webpage? Divide these pages into 20 clusters? The first is supervised. The second isn't. Deep learning refers to a particular type of a particular learning technique: Specifically a neural network that has many hidden (intermediate) layers. Deep learning can be used f…

Thanks for the explanation! I was remembering what flavors of snake oil were being peddled to people in the humanities in the early 2000's, and didn't mean to muddy the waters around technical terms of art.
Post reply on HN