Wouldn't Bayesian filter be better suited? There must be a reason Spam Filter use them instead of Neural Networks.
Using Machine Learning and Node.js to detect the gender of Instagram Users
11–20 of 56 posts
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#12This was submitted 4 days ago [1], and then was deleted. Anyone know what was up with that? [1] https://news.ycombinator.com/item?id=8368186
I deleted it shortly after submitting it, because the demo crashed and we didn't want to waste such a great opportunity on HN on a failed demo.
I know it's not perfect... But heh. Hope it's ok.
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#13> Our platform retrieves or refreshes around 400 user profiles per second (this is managed using 4 high-bandwidth servers co-located with instagram’s API servers on AWS). Interesting, since Instagram's API only allows 5,000 requests per hour, ( http://instagram.com/developer/limits/ ) and does not support bulk requests of user data. How does this application bypass this limit?
Hi minimaxir. We have a large number of tokens from our clients and people doing oauth to access our free demo. Since the data is public, we can use any of these tokens to access hashtags and account followers, etc... Actually, Instagram API limit is pretty high when compared to other platform. Today we have something like 100k tokens available to us, which means we can make 12bn+ calls everyday. Almost like having a…
Interesting, when I was at GoDaddy (Website Builder), it seems Facebook had implemented not only a per token limit, but application limits as well that we hit pretty easily. Does Instagram not have the same kind of limits?
For those curious, IIRC it took a while to get our account's limits raised, and we had to implement some request caching to stay under the limits as much as possible. All around, it was interesting.
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#14Wouldn't Bayesian filter be better suited? There must be a reason Spam Filter use them instead of Neural Networks.
_up we evaluated thoroughly perceptron which are somewhat close to Bayesian networks. Basically a perceptron is a one layer NN and is therefore quite similar to a bayesian network in the fact that it encodes a linear regression.
That being said... studying bayesian networks more thoroughly might raise better results indeed. Don't know though if Gmail is using bayesian networks or deep learning?
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#15Earlier quoted context omitted.
Hi minimaxir. We have a large number of tokens from our clients and people doing oauth to access our free demo. Since the data is public, we can use any of these tokens to access hashtags and account followers, etc... Actually, Instagram API limit is pretty high when compared to other platform. Today we have something like 100k tokens available to us, which means we can make 12bn+ calls everyday. Almost like having a…
Interesting, when I was at GoDaddy (Website Builder), it seems Facebook had implemented not only a per token limit, but application limits as well that we hit pretty easily. Does Instagram not have the same kind of limits? For those curious, IIRC it took a while to get our account's limits raised, and we had to implement some request caching to stay under the limits as much as possible. All around, it was interesting…
Nope they don't... at least not for now :)
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#16Having used /harthur/brain before and being deeply interested in Neural Networks, I have to say that this is one of the most interesting articles about the topic I've ever seen.
Thank you for sharing the C version, I'll use it for sure.
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#17Wouldn't Bayesian filter be better suited? There must be a reason Spam Filter use them instead of Neural Networks.
_up we evaluated thoroughly perceptron which are somewhat close to Bayesian networks. Basically a perceptron is a one layer NN and is therefore quite similar to a bayesian network in the fact that it encodes a linear regression. That being said... studying bayesian networks more thoroughly might raise better results indeed. Don't know though if Gmail is using bayesian networks or deep learning?
My guess is that gmail is using a linear classifier. Both because of the scale of the data, and because up until very recently linear classifiers have been state of the art on text classification.
In the few cases where NN have achieved new state of the art on text, the stanford sentiment analysis work and a few more recent works, a full sentence parse is needed. Sentence parses do achieve 95% accuracy, but only on well structured text in a given domain. Plus, they are hugely time intensive compared to the large scale linear classifiers like vowpal wabbit or sophia-ml.
Regarding perceptrons, a basic perceptron, although it is a linear classifier, will not achieve state of the art. Averaged perceptrons get you closer, but what you really want is a discriminatively trained linear classifier with regularization.
If I had to bet, gmail is probably using something closer to https://code.google.com/p/sofia-ml/ than a NN. Maybe a Googler will surprise me though!
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#181.000 probability of being a man. Thank you for affirming my masculinity. However, my business has a 0.885 probability of being a woman, which is odd for a men's brand.
Not really odd, if your brand is looking to seduce men into buying (;
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#19This was submitted 4 days ago [1], and then was deleted. Anyone know what was up with that? [1] https://news.ycombinator.com/item?id=8368186
I deleted it shortly after submitting it, because the demo crashed and we didn't want to waste such a great opportunity on HN on a failed demo. I know it's not perfect... But heh. Hope it's ok.
The "post if WRONG" twitter link failed on my iPhone 5.
My instagram name is the same as my HN user id, and you classified me with 99.3% as female... Needs work!
Re: Using Machine Learning and Node.js to detect the gender of Instagram Users
#20This is a great example of how privacy is not optional, even in "opt-in" systems such as Instagram and FB. That Instagram does not require you to have a Facebook profile, and Facebook does not require you to list gender means very little in terms of your own privacy.
Merely choosing to withhold information about yourself does not insulate you from a breach of privacy. That others do disclose such information allows 3rd parties to make really good guesses and inferences about you.
There's a strange morality here: at what point is it unethical to voluntarily disclose data about oneself, if it could be used in a way to harm someone else's privacy? Short of drawing a moral boundary (it could very well be impossible), we might do well to at least acknowledge the cost to these methods, alongside their benefits.