Live data from Hacker News

Facebook AI Research Team Open Source DeepMask and SharpMask

code.facebook.com

61–70 of 89 posts

Re: Facebook AI Research Team Open Source DeepMask and SharpMask

#61
post #6

Is there any way for those of us with average intelligence to contribute to tools like this? I know I'm a decent developer, but I feel entirely entirely inadequate to participate in this enormous, scary world of AI.

Playing devil's advocate slightly, but as a web developer recently getting into ML over the last year, it's really nothing that fancy. Even the cutting edge like "word2vec using long short term memory neural networks" is still at its heart a "dumb" approach to 'intelligence'... treat the phenomena like a black box, let your system figure out the 'unknown parameters' automatically from data, don't ask too many questions. Sure there are a lot of aspects to tweak and tune, but at its heart, it's still a 'dumb' approach. It can still get a lot of mileage for a lot of types of tasks, no question, but it's pretty straightforward all in all. Today you can use very accessible Python packages or frameworks like Tensorflow to implement pretty much any of the best learning algorithm almost instantly. There are likely entire fields of ML that I am short changing, but as far as anything popular you read about, which at least I have been exposed to, it's certainly very interesting, but not particularly 'scary' in any sense.

Re: Facebook AI Research Team Open Source DeepMask and SharpMask

#62
post #50
post #6

Is there any way for those of us with average intelligence to contribute to tools like this? I know I'm a decent developer, but I feel entirely entirely inadequate to participate in this enormous, scary world of AI.

You would need to join a community of people who can show you how to contribute to these projects. There are a lot of very active open-source communities, including OpenAI and Deeplearning4j, to name but two.[0][1] People in those communities can't point you in the right direction, if you show you're willing to read the docs and do the work of learning. One thing you will find is that AI requires a lot of non-AI comp…

Why is this comment downvoted? Is this bad advice?

Re: Facebook AI Research Team Open Source DeepMask and SharpMask

#63
post #51

Earlier quoted context omitted.

I completed that course awhile back. Definitely a really great course if you can keep up. It is quite difficult, and I was quite terrible at it. I don't think I have any affinity for the topic, but at least now I can read/discuss the topic without being completely blind. There are also a lot of smaller components in the course that I found useful even not working directly in AI/ML. Just some general data modelling an…

Some AI professors recommend first jumping into a ML framework such as scikit-learn or Keras, which are more approachable, playing with them to the point where a little practical intuition will develop, and only then follow up with theory. Works better in practice than loading up on courses and math at the beginning, and helps the student form practical interest in the field and be more emotionally invested. In other…

Good advice for life in general.

Re: Facebook AI Research Team Open Source DeepMask and SharpMask

#64
post #41

Earlier quoted context omitted.

fwiw, over 4 years ago, I quit a risk quant job at an investment bank and joined Twitter. When I saw all the sophisticated ML systems they had deployed, I asked the same question - How do I, a person of average intelligence with zero exposure to ML, contribute ? Is there anything I can do to get involved? The answer I got was rather unpleasant and won't please everybody. No you cannot contribute. At least not in a di…

While I really appreciate the realism in your post, I wouldn't call webdev/back-end dev shit though. After all, that's what brought us here in the first place and are still heavily needed.

Don't think he was saying that stuff is shit. I think he was using the word the same way you might when saying "Boy, did I get a lot of shit done today!"

Re: Facebook AI Research Team Open Source DeepMask and SharpMask

#66
post #6

Is there any way for those of us with average intelligence to contribute to tools like this? I know I'm a decent developer, but I feel entirely entirely inadequate to participate in this enormous, scary world of AI.

Find applications and use their tools. The development of a new tool is typically harder than applying the tool.

Re: Facebook AI Research Team Open Source DeepMask and SharpMask

#67
post #50

Earlier quoted context omitted.

You would need to join a community of people who can show you how to contribute to these projects. There are a lot of very active open-source communities, including OpenAI and Deeplearning4j, to name but two.[0][1] People in those communities can't point you in the right direction, if you show you're willing to read the docs and do the work of learning. One thing you will find is that AI requires a lot of non-AI comp…

Why is this comment downvoted? Is this bad advice?

Because vonnick has a habit of plugging deeplearning4j in every deep learning-related thread. IMHO, that's somewhat to be expected/laudable here on HN - particularly since deeplearning4j has an open-source framework, and has published interesting and informative blog posts. OTOH, they're ours-is-more-serious because java-is-enterprise thing is a little out of mainstream, so having OpenAI and deeplearning4j being highlighted in a way that seems to equate them isn't as helpful as it appears.

Re: Facebook AI Research Team Open Source DeepMask and SharpMask

#68
post #6

Is there any way for those of us with average intelligence to contribute to tools like this? I know I'm a decent developer, but I feel entirely entirely inadequate to participate in this enormous, scary world of AI.

First, one must understand that these things are not just over, but over-over hyped. It is a socially constructed meme that Deep Learning is only for real geniuses, math PhDs, etc, build by Deep Learning guys themselves.

The problem with AI is that one need enormous money and resources of a big corporation to produce results one could see on AI competitions. It their "research" they do progress, like everyone else, by trial and error (well, augmented with a decent heuristic search process) and the more people and hardware resources they could put in it, the more chances they will outperform other teams. It is resources, not "smartness".

I have completed the very first AI MOOC by Andrew Ng years ago - 780 out of 800 or something. The only difficulty is that it combines methods from math and programming, so one need to have some background to really understand hows and whys. Also really decent knowledge of English is required, otherwise one might miss the nuances in a very dense, loaded with terminology lectures, so, the entry level is quite high (of course, one could always copy-paste code without understanding and use ready-made toolkits and tutorials).

Apart from that it is nothing special. Basically, it is a function composition, with linear algebra and some numerical optimizations. When you have understood the basic building blocks - mathematical functions, processes and algorithms involved, there is nothing much else to do - one has to apply the theoretical knowledge which is, again, not a big deal, to real problems, and this is where big corps with resources took the advantage.

As long as you manage to get inside one of bigcorp AI lab, you become a star, simply because of the well funded PR machine of the corp. Everything that comes out is super cool, of course, so even being mentioned in the context makes one super cool too.

In my opinion, the guys from upper middle class families, who went through a decent technical school (with mom and dad's money) which taught them the basis needed for entering AI, are not that special. I probably could beat one or two of such snobs, having no high school education at all, never studied English or programming in a school and being raised in an impoverished family, but this is another story.

As for ML, take Andrew Ng's course, it is pretty accessible, and then take the one on the Udacity (with all these arrogant hot shots) and realize that there is really no magic in it. It is not that hard.

When you see a cool paper or video about some "breakthroughs" it ML, take into account that it is mostly due to resources spent on it, not some kind of extraordinary genius of the authors of the paper. Remember, all they do is basically a heuristic search and constraint satisfaction problems - train, test, change function (layer) composition (usually, without real understanding of whys), re-train, re-test. The problem is that there are very few of such slots in megacorps.

The guys like Andrew Ng himself are, of course, the real stars. But this kind of success comes from years of rigorous training similar to what Olympic champions have undergo. I personally don't think I have such ambitions or wish to embrace such lifestyle.

Re: Facebook AI Research Team Open Source DeepMask and SharpMask

#69
post #41
post #6

Is there any way for those of us with average intelligence to contribute to tools like this? I know I'm a decent developer, but I feel entirely entirely inadequate to participate in this enormous, scary world of AI.

fwiw, over 4 years ago, I quit a risk quant job at an investment bank and joined Twitter. When I saw all the sophisticated ML systems they had deployed, I asked the same question - How do I, a person of average intelligence with zero exposure to ML, contribute ? Is there anything I can do to get involved? The answer I got was rather unpleasant and won't please everybody. No you cannot contribute. At least not in a di…

> What worked for me personally was finding a very small company with a tiny data science department, that was headed by an ML PhD who was ready to mentor me

IMO this is excellent advice for anyone who wants to move into a new field, and I've personally learned many of my skills through this kind of situation. Get yourself a job somewhere small but ambitious, and you'll end up wearing a lot of hats and doing new things simply because you put your hand up for them. Then when it's time to move on, voila! You have X years commercial experience in a whole bunch of things and you put the one that you want to focus on next onto your resume.

The bigger the company, the smaller the pidgeonhole you'll live in and the less likely you are to ever end up doing anything outside your original job description.

Post reply on HN