If we could stop using the term Neural Networks in relation to computing, that would be great. Computers don't have neurons.
[deleted]
TensorFlow: open-source library for machine intelligence
41–50 of 211 posts
Re: TensorFlow: open-source library for machine intelligence
#42If we could stop using the term Neural Networks in relation to computing, that would be great. Computers don't have neurons.
There are artificial and biological neural networks. The artificial one is based upon the biological one. Therefore dropping the 'artificial' or 'biological' seems fine to me.
Re: TensorFlow: open-source library for machine intelligence
#43> This open source release supports single machines and mobile devices. Can someone clarify if "single machines" means the Apache license only applies to single machines and not distributed systems? Sidenote: I wish every open source project had a release video.
> Can someone clarify if "single machines" means the Apache license only applies to single machines and not distributed systems?
I'm not aware that there is a way to do that and still legitimately call it the Apache license. I took the statement to mean that the source does not have the capability of parallelizing across machine boundaries.
Re: TensorFlow: open-source library for machine intelligence
#44Are there any major conceptual differences to Theano? Not that I wouldn't appreciate a more polished, well funded competitor in the same space.
It looks like using TensorFlow from Python will feel quite familiar to a Theano user, starting with the separation of graph building and graph running, but also down into the details of how variables, inputs and 'givens' (called feed dicts in tensorflow) are handled.
Re: TensorFlow: open-source library for machine intelligence
#45Earlier quoted context omitted.
This "backwards" meme doesn't make any sense. Python 2 and Python 3 are different languages that happen to share the same name, a lot of syntax, and near-source compatibility, but they've been developed concurrently for ten years now. It's kind of like C and C++. If the current Python 2 team (which is part of the Python Software Foundation) abandons it, probably somebody else will take over maintenance, because it se…
The Python Software Foundation has stated explicitly that Python 2.7 will EOL in 2020...
...but the science guys have been offered zero incentive to move, this "end of life" argument has been worked to death without success, and so it's perhaps time to shift focus to the science community's real needs (ie: GPU).
Re: TensorFlow: open-source library for machine intelligence
#46Does anyone know how this compares to Twitter's recently released torch autograd?
https://blog.twitter.com/2015/autograd-for-torch
EDIT: To be a bit more specific, autograd just requires that one writes the forward model, and it can involve any program logic like conditionals, etc, so long as the end result is differentiable. It then takes care of all the gradient calculations.
Re: TensorFlow: open-source library for machine intelligence
#47> The TensorFlow Python API requires Python 2.7 The whole scientific Python stack is available for Python 3. This seems like a somewhat backwards thing to do -- or perhaps the requirement is intended to mean at least 2.7? Edit: added context Edited again: More careful wording
I am really excited about this library. Tensors are the future; matrices are going to look so old in a few years. In fairness, Theano already knew that. I cannot wait to dig into this and am very relieved that Google's best are still using Python for this endeavour...but...using Python 2.7. I have just recently been persuaded by the community that 3.5 is cost free, and here I have this enormous counterexample. For th…
> Tensors are the future; matrices are going to look so old in a few years.
I am honestly curious about this point of view. Is there any example where actual multidimensional tensor have any relevance? What I mostly see around is just standard linear algebra operations on matrices and vectors lifted to higher-dimensional tensors point-wise (for instance applying a certain operation to all 2-dimensional subtensors of a given tensor).
I never saw the need for modeling matrices in terms of tensors - the latter seem just more complex to use and usually tensor operations (like symmetrization, antisymmetrization, wedge products...) are not even available in libraries
(And by the way, both matrices and tensors are now more than one century old...)
Re: TensorFlow: open-source library for machine intelligence
#48Are there any major conceptual differences to Theano? Not that I wouldn't appreciate a more polished, well funded competitor in the same space. It looks like using TensorFlow from Python will feel quite familiar to a Theano user, starting with the separation of graph building and graph running, but also down into the details of how variables, inputs and 'givens' (called feed dicts in tensorflow) are handled.
I'm looking at the RNN implementation right now (https://github.com/tensorflow/tensorflow/blob/master/tensorf...). It looks like the loop over the time frames is actually in Python itself.
for time, input_ in enumerate(inputs): ...
I also haven't seen some theano.scan equivalent. Which is not needed in many cases when you know the shape in advance.
Re: TensorFlow: open-source library for machine intelligence
#49> The TensorFlow Python API requires Python 2.7 The whole scientific Python stack is available for Python 3. This seems like a somewhat backwards thing to do -- or perhaps the requirement is intended to mean at least 2.7? Edit: added context Edited again: More careful wording
It has a C++ API, so there is no lock-in to Python, either 2.7 or 3.x.
Re: TensorFlow: open-source library for machine intelligence
#50I'm kinda floored, by this. Have been developing a flow based language to do this. Even started with the approach of using Python and then moving to scripting directly in C++. Maybe I tweak my own project. Anyone playing with low level GPU deployments, like Metal?
[EDIT] Ok, so there is some GPU - should probably play some more before asking obvious questions. Really keen on scripting out flow directly.