Earlier quoted context omitted.
Nice, lol, hope TensorFlow didn't scoop any of your ideas too. ;) Overall, it's exciting to see data-flow paradigms gain popularity. What kind of dataflow approach are you most interested in? I've been shifting my approach to work within existing systems. One things I've been doing is abusing the intent of web-components and DOM events to create data visualization tools. Recently my team and I decided to focus down a…
Nothing too serious ... mostly to glue embedded machine vision system components together in a simulation environment.
TensorFlow: open-source library for machine intelligence
181–190 of 211 posts
Re: TensorFlow: open-source library for machine intelligence
#182Earlier quoted context omitted.
> Tensors are the future; matrices are going to look so old in a few years. I am honestly curious about this point of view. Is there any example where actual multidimensional tensor have any relevance? What I mostly see around is just standard linear algebra operations on matrices and vectors lifted to higher-dimensional tensors point-wise (for instance applying a certain operation to all 2-dimensional subtensors of…
> What I mostly see around is just standard linear algebra operations on matrices and vectors lifted to higher-dimensional tensors point-wise Equally what is matrix multiplication but a bunch of 1-dimensional dot products applied pointwise? why do we need matrices? I do get what you're saying, and that part of it is that ML / CS folk just use 'tensor' as a fancy word for a multi-dimensional array, whereas physics fol…
So what algebraic concept do tensors correspond to?
Re: TensorFlow: open-source library for machine intelligence
#183Earlier quoted context omitted.
Why wouldn't this work in Theano? >>> import theano >>> import theano.tensor as T >>> state = theano.shared(1.0) >>> states = [] >>> for step in range(10): >>> state = state + state >>> states.append(state) >>> >>> f = theano.function([], states) >>> f() [array(2.0), array(4.0), array(8.0), array(16.0), array(32.0), array(64.0), array(128.0), array(256.0), array(512.0), array(1024.0)]
Thanks! When I tried this before, I thought compilation was stuck in an infinite loop and gave up after about a minute. But you're right, it works. Though on my machine, this took two and a half minutes to compile (ten times as long as compiling a small convnet). For 10 recurrence steps, that's weird, right? And the TensorFlow thing above runs instantly.
Re: TensorFlow: open-source library for machine intelligence
#184Earlier quoted context omitted.
One small note on the paper itself. I love that the paper's author are in alphabetical orders, without any stupid jostling over first/last authorship. I think that's fantastic and wish academia went that way too (yeah right).
Why is alphabetical order great? It just only means that people with last names starting with z will get penalized every single time because of choosing wrong parents! I would think randomized order would be chosen - especially if you were mathematician.
Re: TensorFlow: open-source library for machine intelligence
#185This is really significant. At this moment in history, the growth of computer power has made a bunch of important signal-processing and statistical tasks just feasible, so we are seeing things like self-driving cars, superhuman image recognition, and so on. But it's been very difficult to take advantage of the available computational power, because it's in the form of GPUs and clusters. TensorFlow is a library design…
What about Torch or Theano which allow you to use multiple GPUs and clusters? they also have a wide array of libraries which allows you to extend capabilities (itorch etc.). torch is also very fast, most parts written in C so I don't know if Tensorflow would be really that fast compared to existing librairies. One thing find I found interesting is the ability to use the software you designed in research directly in p…
Re: TensorFlow: open-source library for machine intelligence
#186Re: TensorFlow: open-source library for machine intelligence
#187This is really significant. At this moment in history, the growth of computer power has made a bunch of important signal-processing and statistical tasks just feasible, so we are seeing things like self-driving cars, superhuman image recognition, and so on. But it's been very difficult to take advantage of the available computational power, because it's in the form of GPUs and clusters. TensorFlow is a library design…
Depending on how long it takes to "evaluate the goodness of a solution" techniques like multi-start gradient decent can rapidly become intractable though, especially in higher dimensions. There are a handful of open source libraries out there that try to tackle this time consuming and expensive black box optimization problem from a more Bayesian approach [1] [2]. There's also a YC company to do this as a service (ful…
Re: TensorFlow: open-source library for machine intelligence
#188Earlier quoted context omitted.
> What I mostly see around is just standard linear algebra operations on matrices and vectors lifted to higher-dimensional tensors point-wise Equally what is matrix multiplication but a bunch of 1-dimensional dot products applied pointwise? why do we need matrices? I do get what you're saying, and that part of it is that ML / CS folk just use 'tensor' as a fancy word for a multi-dimensional array, whereas physics fol…
The traditional pure mathematical of looking at it is that vectors are members of a vector space. Matrices are linear maps, and matrix multiplication is composition of linear maps. So what algebraic concept do tensors correspond to?
Re: TensorFlow: open-source library for machine intelligence
#189Earlier quoted context omitted.
Why is alphabetical order great? It just only means that people with last names starting with z will get penalized every single time because of choosing wrong parents! I would think randomized order would be chosen - especially if you were mathematician.
"Choose" parents with a surname starting with A then.
Or use a pseudonym.