Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Getting Started with Deep Learning: A Review of Available Tools

svds.com

Post reply on HN
Print view View original

11–19 of 19 posts

Re: Getting Started with Deep Learning: A Review of Available Tools

#11

Post by dontreact »

curuinor wrote: post #7
curuinor wrote: post #6

Earlier quoted context omitted.

Chainer is about 50k sloc of very idiomatic Python and a little dealie for emulating numpy in GPU and a bit of Cython. TensorFlow is about 700k sloc of C++, Python, some Golang for some godawful reason, with an enormous annoying build dealie. That was my own decision calculus, anyhow. Speed of development and complexity still matter in machine learning land, you know.

One more objectionable fact about TF: There's a separate better documentation repo for Google insiders only. That's not kosher.

How do you think it's better? I use both the internal and external and the only difference is that there are more Google-infra specific things internally. The external one is prettier :)

Re: Getting Started with Deep Learning: A Review of Available Tools

#12

Post by physicsyogi »

There's an error in the article about PyTorch:

"For instance, Caffe (C++) and Torch (Lua) have Python bindings for its codebase (with PyTorch being released in January 2017), but we would recommend that you are proficient with C++ or Lua respectively if you would like to use those technologies."

You don't need to know any Lua to use PyTorch. That's the point. Lua is for Torch.

Edit: The author may be confusing the PyTorch released by the Torch developers with the earlier pytorch project that did wrap Torch.

Re: Getting Started with Deep Learning: A Review of Available Tools

#13

Post by sdrothrock »

vonnik wrote: post #4

This list is woefully incomplete. It should be titled "A Review of Some Tools". Those it doesn't include, or does not give proper mention to in its top table, are: Chainer, DyNet, Paddle and Deeplearning4j.[0] Even Keras, the third most popular DL library, is given short shrift, even though it is easier to use than TensorFlow, and can handle Theano, TF, CNTK and Deeplearning4j as backends. All of the missing libs hav…

> TensorFlow, which appears to be winning chiefly on Github stars

I was under the impression that a lot of TensorFlow's reputation and image comes from the fact that it's Google-backed and -dogfooded, meaning that it will stay in active and useful development for the foreseeable future.

Re: Getting Started with Deep Learning: A Review of Available Tools

#14

Post by curuinor »

dontreact wrote: post #11
curuinor wrote: post #7

Earlier quoted context omitted.

One more objectionable fact about TF: There's a separate better documentation repo for Google insiders only. That's not kosher.

How do you think it's better? I use both the internal and external and the only difference is that there are more Google-infra specific things internally. The external one is prettier :)

It is definitely the case that a fair few of those 700k sloc are devoted to poking at and wibbling with Google infra specific things. Which is of basically negative value if you're some rando using it.

There are also a fair few non-infra specific bits to the internal documentation.

Re: Getting Started with Deep Learning: A Review of Available Tools

#15

Post by kriro »

The best resource (imo) is "Practical Deep Learning". As the title suggests it is...well practical. They specifically say that a lot of Deep Learning seems to be made complex on purpose and that it's important to get a good overview and start doing stuff immediately. They use old Keggle competitions as a benchmark. After lesson 1 you can already recreate the infamous dog/cat classifier and get pretty amazing accuracy (>90% iirc). It's all free and online, there's also a paid on premise course (in San Francisco iirc). They use Keras (so one level of abstraction higher than the stuff in the post) and make heavy use of Python Notebooks. I also love the approach of using AWS p2 instances for everything...very nice to pay as you go for the GPU power (I wasn't even aware these types of instances existed before watching the videos). The second course isn't online yet but the claim is that you'll be at the bleeding edge after that one (i.e. compete with state of the art papers). I fully believe it.

http://course.fast.ai/

Re: Getting Started with Deep Learning: A Review of Available Tools

#16

Post by sprobertson »

kriro wrote: post #15

The best resource (imo) is "Practical Deep Learning". As the title suggests it is...well practical. They specifically say that a lot of Deep Learning seems to be made complex on purpose and that it's important to get a good overview and start doing stuff immediately. They use old Keggle competitions as a benchmark. After lesson 1 you can already recreate the infamous dog/cat classifier and get pretty amazing accuracy…

Notebooks are perfect for presenting these kind of project based lessons (except that GitHub doesn't render them on mobile). I'm just starting a similar series, entirely in Notebooks, doing natural language tasks with neural networks in PyTorch:

https://github.com/spro/practical-pytorch

Re: Getting Started with Deep Learning: A Review of Available Tools

#17

Post by nnq »

curuinor wrote: post #6
vonnik wrote: post #4

This list is woefully incomplete. It should be titled "A Review of Some Tools". Those it doesn't include, or does not give proper mention to in its top table, are: Chainer, DyNet, Paddle and Deeplearning4j.[0] Even Keras, the third most popular DL library, is given short shrift, even though it is easier to use than TensorFlow, and can handle Theano, TF, CNTK and Deeplearning4j as backends. All of the missing libs hav…

Chainer is about 50k sloc of very idiomatic Python and a little dealie for emulating numpy in GPU and a bit of Cython. TensorFlow is about 700k sloc of C++, Python, some Golang for some godawful reason, with an enormous annoying build dealie. That was my own decision calculus, anyhow. Speed of development and complexity still matter in machine learning land, you know.

> some Golang for some godawful reason

What's the problem with Golang in TF? It's one of the nice to work in languages and I imagine that Google sees Golang as somehting that will replace Python sometime long term...

Post reply on HN