Neural networks have their place, but are probably the most complicated and opaque machine learning tool. They are also hard to set up: so many parameters! Given that, I found it really strange that they went straight for a neural network (and then implemented one themselves!). Surely the place to start would be Naive Bayes, followed up with regularized logistic regression (through something like glmnet). Heck, even…
Using Machine Learning and Node.js to detect the gender of Instagram Users
51–56 of 56 posts
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#52Earlier quoted context omitted.
_up we evaluated thoroughly perceptron which are somewhat close to Bayesian networks. Basically a perceptron is a one layer NN and is therefore quite similar to a bayesian network in the fact that it encodes a linear regression. That being said... studying bayesian networks more thoroughly might raise better results indeed. Don't know though if Gmail is using bayesian networks or deep learning?
I don't know about GMail specifically, but I suspect your approach of using neural networks is the best one given the state-of-the-art in machine learning today. You can think of naive bayes and a perceptron as roughly equivalent in terms of expressiveness--they're both linear models--but a perceptron is usually better since it can account for correlations between input variables. As you say, a perceptron is a one-la…
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#53What seems odd is that the "test tool" allows you to tweet whether it's wrong or right. Why not just have it make a call to your API or something to tell you directly, so you can look at the profiles and figure out what's gone wrong?
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#54Your implementation of momentum seems off, you just add a multiple of last error, instead of adding exponentially declining contributions from the past. I think you want double dW = alpha_ * val_[l][j] * D_[l+1][i] + beta_ * dW_[l+1][i][j]; W_[l+1][i][j] += dW; If you want to get an output class probability, softmax is the standard way. Minimize KL-divergence instead of squared error. You don't seem to be doing any r…
> Your implementation of momentum seems off I think we used what is described in Artificial Intelligence: A Modern Approach... But I have to check because what you propose seems better. > If you want to get an output class probability, softmax is the standard way. Minimize KL-divergence instead of squared error. Thanks! We'll totally try that. > You don't seem to be doing any regularization. It could maybe give you b…
oops maybe I spoke too soon, allow me to backpedal a little. I still recommend minimizing KL-divergence.
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#55Giving it a go with most of my friends and I'd say the success rate was definitely below .5, and it was pretty sure about it. What seems odd is that the "test tool" allows you to tweet whether it's wrong or right. Why not just have it make a call to your API or something to tell you directly, so you can look at the profiles and figure out what's gone wrong?
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#56Neural networks have their place, but are probably the most complicated and opaque machine learning tool. They are also hard to set up: so many parameters! Given that, I found it really strange that they went straight for a neural network (and then implemented one themselves!). Surely the place to start would be Naive Bayes, followed up with regularized logistic regression (through something like glmnet). Heck, even…
Although their computing is very smart, the output cant be better than the input they used. Just determining the gender by looking up a related Facebook-Profile should therefore be a better solution in my opinion.