Live data from Hacker News

Learning to Learn in TensorFlow

github.com

21–22 of 22 posts

Re: Learning to Learn in TensorFlow

#21
post #14
post #10

Earlier quoted context omitted.

"Automatically" isn't the best word, as TensorFlow won't make use of multiple GPUs unless you explicitly tell it to (at this time). That said, there are a number of benefits to using TensorFlow (including the ability to use multiple GPUs, if not automatically :) ) - Several common gradient optimization algorithms (Momentum, AdaGrad, AdaDelta, Adam, etc) are implemented already, which makes it a bit faster to get your…

> - There are tools for compiling your trained models as static C++ binaries on mobile devices I'm looking for such tool but I haven't found anything apart from C++ libraries that also focus on training. Can you give me some pointers? Thanks.

In the contrib folder in the TensorFlow project, you'll find the makefile subdirectory:

https://github.com/tensorflow/tensorflow/tree/master/tensorf...

The readme has a general overview of how you'll approach using it. Note that you'll want to optimize for inference (remove unnecessary operations from the graph) [0] and freeze your graph (convert Variables into constant tensors) [1] to drop in your own model for the pretrained Inception model that's used as an example.

[0]: https://github.com/tensorflow/tensorflow/blob/master/tensorf...

[1]: https://github.com/tensorflow/tensorflow/blob/master/tensorf...

Re: Learning to Learn in TensorFlow

#22
post #10
post #5

Earlier quoted context omitted.

I've heard that Tensorflow is built to take advantage of multiple GPUs automatically, whereas Theano (by default at least) can only make use of a single GPU.

"Automatically" isn't the best word, as TensorFlow won't make use of multiple GPUs unless you explicitly tell it to (at this time). That said, there are a number of benefits to using TensorFlow (including the ability to use multiple GPUs, if not automatically :) ) - Several common gradient optimization algorithms (Momentum, AdaGrad, AdaDelta, Adam, etc) are implemented already, which makes it a bit faster to get your…

Actually, Theano supports multiple GPUs as well: http://deeplearning.net/software/theano/tutorial/using_multi...
Post reply on HN