Live data from Hacker News

Hello, Tensorflow

oreilly.com

21–30 of 44 posts

Re: Hello, Tensorflow

#21
post #14

TensorFlow is admirably easier to install than some other frameworks I thought most frameworks are fairly easy to install in python, usually with a single call to pip. NLTK takes one "pip install nltk" and then "python", "import nltk", "nltk.download()" to download all the corpuses and miscellaneous data. Installing tensorflow seems complicated compared to that. # Ubuntu/Linux 64-bit, CPU only: $ sudo pip install --u…

Fwiw, Deeplearning4j is also quite easy to install:

http://deeplearning4j.org/quickstart

https://github.com/deeplearning4j

Re: Hello, Tensorflow

#22
post #20
post #14

TensorFlow is admirably easier to install than some other frameworks I thought most frameworks are fairly easy to install in python, usually with a single call to pip. NLTK takes one "pip install nltk" and then "python", "import nltk", "nltk.download()" to download all the corpuses and miscellaneous data. Installing tensorflow seems complicated compared to that. # Ubuntu/Linux 64-bit, CPU only: $ sudo pip install --u…

clearly you haven't tried to install caffe

Like I said, I have not played around with a lot of DL frameworks, only more general python things. I'll take note of that, I'm really interested on how difficult different DL frameworks are to set up.

Re: Hello, Tensorflow

#23

As I've been reading about tensorflow lately I feel like I'm missing something regarding distributed processing. How can Tensorflow 'scale up' easily if you are outside of Google? We have big datasets that I want to run learning on but it seems awkward to do with tensorflow. We're big enough that the team managing our cluster is separate than development and it is a huge pain if we need them to go install tools on ea…

Have you read through https://www.tensorflow.org/versions/master/how_tos/distribut... ? Since version 0.8 of TensorFlow they've had a way to do distributed processing.

Their blog post in April mentioned it - https://research.googleblog.com/2016/04/announcing-tensorflo...

That said, I haven't actually attempted any distributed processing, but it looks possible. If anyone has actually tried it and can speak to it I would be curious to what people with experience have to say about it.

Re: Hello, Tensorflow

#24
I like the clarity of thought and structure of the article. I have used Tensorflow and had to explain it to a friend. So many times, I end up assuming things which are obvious to me but not to someone getting started. As said in the article, Tensorflow stands out for the ease of use and is to the best of my knowledge first distributed learning framework. Theano, Torch et al are faster but do not come with goodies like Tensorboard.

Re: Hello, Tensorflow

#25

As I've been reading about tensorflow lately I feel like I'm missing something regarding distributed processing. How can Tensorflow 'scale up' easily if you are outside of Google? We have big datasets that I want to run learning on but it seems awkward to do with tensorflow. We're big enough that the team managing our cluster is separate than development and it is a huge pain if we need them to go install tools on ea…

No, you're not. Google did this with their build engine (Blaze, internally - Bazel is the open-source API, lacking a distributed build platform). Google are doing this with Apache Beam (the API to Google dataflow) - releasing an API for local testing but not releasing the distributed engine. If you have your data in a Hadoop cluster and are doing image recognition, Yahoo's Cafe on Spark is the only truly distributed…

Keep in mind there's different kinds of parallelism though. If you mean model parallel, a lot of shops are doing that via RDMA as well as MPI. It depends on how you handle state though.

There's also data parallelism with parameter averaging which we've been doing in deeplearning4j for the last few years. We also support ALOT more than just images. We have the ETL pipelines (kafka etc) to go with it. Watch for a blog post from us on parallel for all (nvidia's blog) where we explain some of this.

I gave a framework agnostic view of the concepts you should consider when looking at distributed deep learning as well:

http://www.slideshare.net/agibsonccc/brief-introduction-to-d...

Re: Hello, Tensorflow

#26
post #19

Wow! I was going to post this but here it is already! I wrote (with a lot of help) the article there. I also jotted down some notes on the process of writing it with O'Reilly in case anybody's interested in that side of things: http://planspace.org/20160619-writing_with_oreilly/

Just a CSS critique: could you add "monospace" to the end of your list of monospaced fonts? I have perfectly good monospaced fonts on this computer, but none of them are Consolas, Menlo, Monaco, or Lucida Console, so I end up with a default proportional serif font.

This might seem like an innocent change but it really is another HTML/CSS browser hell hole. If I remember correctly it was Jeff Atwood or jzy who taught me this lesson at a time when Stackoverflow was just out of Beta:

If the keyword monospace is somewhere in your font stack some browsers use 13px as default font size instead of the usual 16px. The workaround used to be to use both, serif and monospace, in your font stack. This used to work some time ago, I don't know if it still does with contemporary browsers.

Re: Hello, Tensorflow

#27
post #19

Wow! I was going to post this but here it is already! I wrote (with a lot of help) the article there. I also jotted down some notes on the process of writing it with O'Reilly in case anybody's interested in that side of things: http://planspace.org/20160619-writing_with_oreilly/

Just a CSS critique: could you add "monospace" to the end of your list of monospaced fonts? I have perfectly good monospaced fonts on this computer, but none of them are Consolas, Menlo, Monaco, or Lucida Console, so I end up with a default proportional serif font.

Thanks for the feedback! I'll pass along to the O'Reilly team and see if there's anything they can do.

Re: Hello, Tensorflow

#28

Wow! I was going to post this but here it is already! I wrote (with a lot of help) the article there. I also jotted down some notes on the process of writing it with O'Reilly in case anybody's interested in that side of things: http://planspace.org/20160619-writing_with_oreilly/

It was nice to hear a little behind the scenes. I'd be curious to hear any analytics about unique visitors, etc so far from the O'Reilly post if you can share.

I'm curious too! I don't know yet whether they'll pass that info to me, and then I don't know whether I would be able to pass on any further. I imagine at least some of the analytics are considered proprietary/competitive info. But we can see some public things like votes here, number of tweets, etc.

Re: Hello, Tensorflow

#29
post #19

Earlier quoted context omitted.

Just a CSS critique: could you add "monospace" to the end of your list of monospaced fonts? I have perfectly good monospaced fonts on this computer, but none of them are Consolas, Menlo, Monaco, or Lucida Console, so I end up with a default proportional serif font.

Thanks for the feedback! I'll pass along to the O'Reilly team and see if there's anything they can do.

[deleted]

Re: Hello, Tensorflow

#30
post #17
post #16

Earlier quoted context omitted.

Compared to other frameworks which allow for deep learning, it's much easier to install.

I see. The article was a bit vague for me in what it means by frameworks (does NLTK count? Django? DL frameworks in other languages?), and since I don't know the area too well, that struck out to me as odd. It honestly looks like pretty cool stuff, looking forward to having time to play around with it some day.

Thanks! I didn't want to name names in the comparison to other frameworks, but I was thinking mostly of Caffe, which doesn't have any install path as simple as just a `pip install`. Other DL frameworks would be things like torch, theano, etc.
Post reply on HN