Live data from Hacker News

Using Machine Learning and Node.js to detect the gender of Instagram Users

totems.co

51–56 of 56 posts

Re: Using Machine Learning and Node.js to detect the gender of Instagram Users

#51

Neural networks have their place, but are probably the most complicated and opaque machine learning tool. They are also hard to set up: so many parameters! Given that, I found it really strange that they went straight for a neural network (and then implemented one themselves!). Surely the place to start would be Naive Bayes, followed up with regularized logistic regression (through something like glmnet). Heck, even…

Well said - this is a crazily over-engineered and highly problematic approach to the problem at hand.

Re: Using Machine Learning and Node.js to detect the gender of Instagram Users

#52
post #14

Earlier quoted context omitted.

_up we evaluated thoroughly perceptron which are somewhat close to Bayesian networks. Basically a perceptron is a one layer NN and is therefore quite similar to a bayesian network in the fact that it encodes a linear regression. That being said... studying bayesian networks more thoroughly might raise better results indeed. Don't know though if Gmail is using bayesian networks or deep learning?

I don't know about GMail specifically, but I suspect your approach of using neural networks is the best one given the state-of-the-art in machine learning today. You can think of naive bayes and a perceptron as roughly equivalent in terms of expressiveness--they're both linear models--but a perceptron is usually better since it can account for correlations between input variables. As you say, a perceptron is a one-la…

Arguing that using a neural network instead of a simpler classifier is a good idea because of recent developments in deep learning is like arguing that driving a car from the 50s is safer than taking a train because of recent developments in airbag/cruise control technology.

Re: Using Machine Learning and Node.js to detect the gender of Instagram Users

#53
Giving it a go with most of my friends and I'd say the success rate was definitely below .5, and it was pretty sure about it.

What seems odd is that the "test tool" allows you to tweet whether it's wrong or right. Why not just have it make a call to your API or something to tell you directly, so you can look at the profiles and figure out what's gone wrong?

Re: Using Machine Learning and Node.js to detect the gender of Instagram Users

#54
post #41
post #38

Your implementation of momentum seems off, you just add a multiple of last error, instead of adding exponentially declining contributions from the past. I think you want double dW = alpha_ * val_[l][j] * D_[l+1][i] + beta_ * dW_[l+1][i][j]; W_[l+1][i][j] += dW; If you want to get an output class probability, softmax is the standard way. Minimize KL-divergence instead of squared error. You don't seem to be doing any r…

> Your implementation of momentum seems off I think we used what is described in Artificial Intelligence: A Modern Approach... But I have to check because what you propose seems better. > If you want to get an output class probability, softmax is the standard way. Minimize KL-divergence instead of squared error. Thanks! We'll totally try that. > You don't seem to be doing any regularization. It could maybe give you b…

>Thanks! We'll totally try that.

oops maybe I spoke too soon, allow me to backpedal a little. I still recommend minimizing KL-divergence.

Re: Using Machine Learning and Node.js to detect the gender of Instagram Users

#55

Giving it a go with most of my friends and I'd say the success rate was definitely below .5, and it was pretty sure about it. What seems odd is that the "test tool" allows you to tweet whether it's wrong or right. Why not just have it make a call to your API or something to tell you directly, so you can look at the profiles and figure out what's gone wrong?

2 more epicly failing profiles: @friendzis @algimantas69

Re: Using Machine Learning and Node.js to detect the gender of Instagram Users

#56

Neural networks have their place, but are probably the most complicated and opaque machine learning tool. They are also hard to set up: so many parameters! Given that, I found it really strange that they went straight for a neural network (and then implemented one themselves!). Surely the place to start would be Naive Bayes, followed up with regularized logistic regression (through something like glmnet). Heck, even…

I am not sure whether I understood everything right, but I think they computed just with the data they got from the links to Facebook-Profiles.

Although their computing is very smart, the output cant be better than the input they used. Just determining the gender by looking up a related Facebook-Profile should therefore be a better solution in my opinion.

Post reply on HN