Live data from Hacker News

TensorFlow: open-source library for machine intelligence

tensorflow.org

181–190 of 211 posts

Re: TensorFlow: open-source library for machine intelligence

#181

Earlier quoted context omitted.

Nice, lol, hope TensorFlow didn't scoop any of your ideas too. ;) Overall, it's exciting to see data-flow paradigms gain popularity. What kind of dataflow approach are you most interested in? I've been shifting my approach to work within existing systems. One things I've been doing is abusing the intent of web-components and DOM events to create data visualization tools. Recently my team and I decided to focus down a…

Nothing too serious ... mostly to glue embedded machine vision system components together in a simulation environment.

Do you guys know of any theoretical analysis on Data flow vs Control flow software ?

Re: TensorFlow: open-source library for machine intelligence

#182
post #151
post #47

Earlier quoted context omitted.

> Tensors are the future; matrices are going to look so old in a few years. I am honestly curious about this point of view. Is there any example where actual multidimensional tensor have any relevance? What I mostly see around is just standard linear algebra operations on matrices and vectors lifted to higher-dimensional tensors point-wise (for instance applying a certain operation to all 2-dimensional subtensors of…

> What I mostly see around is just standard linear algebra operations on matrices and vectors lifted to higher-dimensional tensors point-wise Equally what is matrix multiplication but a bunch of 1-dimensional dot products applied pointwise? why do we need matrices? I do get what you're saying, and that part of it is that ML / CS folk just use 'tensor' as a fancy word for a multi-dimensional array, whereas physics fol…

The traditional pure mathematical of looking at it is that vectors are members of a vector space. Matrices are linear maps, and matrix multiplication is composition of linear maps.

So what algebraic concept do tensors correspond to?

Re: TensorFlow: open-source library for machine intelligence

#183

Earlier quoted context omitted.

Why wouldn't this work in Theano? >>> import theano >>> import theano.tensor as T >>> state = theano.shared(1.0) >>> states = [] >>> for step in range(10): >>> state = state + state >>> states.append(state) >>> >>> f = theano.function([], states) >>> f() [array(2.0), array(4.0), array(8.0), array(16.0), array(32.0), array(64.0), array(128.0), array(256.0), array(512.0), array(1024.0)]

Thanks! When I tried this before, I thought compilation was stuck in an infinite loop and gave up after about a minute. But you're right, it works. Though on my machine, this took two and a half minutes to compile (ten times as long as compiling a small convnet). For 10 recurrence steps, that's weird, right? And the TensorFlow thing above runs instantly.

Agreed. Theano has trouble dealing efficiently with very deeply nested graphs.

Re: TensorFlow: open-source library for machine intelligence

#184
post #87

Earlier quoted context omitted.

One small note on the paper itself. I love that the paper's author are in alphabetical orders, without any stupid jostling over first/last authorship. I think that's fantastic and wish academia went that way too (yeah right).

Why is alphabetical order great? It just only means that people with last names starting with z will get penalized every single time because of choosing wrong parents! I would think randomized order would be chosen - especially if you were mathematician.

"Choose" parents with a surname starting with A then.

Re: TensorFlow: open-source library for machine intelligence

#185
post #40
post #8

This is really significant. At this moment in history, the growth of computer power has made a bunch of important signal-processing and statistical tasks just feasible, so we are seeing things like self-driving cars, superhuman image recognition, and so on. But it's been very difficult to take advantage of the available computational power, because it's in the form of GPUs and clusters. TensorFlow is a library design…

What about Torch or Theano which allow you to use multiple GPUs and clusters? they also have a wide array of libraries which allows you to extend capabilities (itorch etc.). torch is also very fast, most parts written in C so I don't know if Tensorflow would be really that fast compared to existing librairies. One thing find I found interesting is the ability to use the software you designed in research directly in p…

TensorFlow seems to have better multi cpu/gpu support than Theano.

Re: TensorFlow: open-source library for machine intelligence

#187
post #8

This is really significant. At this moment in history, the growth of computer power has made a bunch of important signal-processing and statistical tasks just feasible, so we are seeing things like self-driving cars, superhuman image recognition, and so on. But it's been very difficult to take advantage of the available computational power, because it's in the form of GPUs and clusters. TensorFlow is a library design…

Depending on how long it takes to "evaluate the goodness of a solution" techniques like multi-start gradient decent can rapidly become intractable though, especially in higher dimensions. There are a handful of open source libraries out there that try to tackle this time consuming and expensive black box optimization problem from a more Bayesian approach [1] [2]. There's also a YC company to do this as a service (ful…

Could something like MOE be made to run on TensorFlow?

Re: TensorFlow: open-source library for machine intelligence

#188
post #151

Earlier quoted context omitted.

> What I mostly see around is just standard linear algebra operations on matrices and vectors lifted to higher-dimensional tensors point-wise Equally what is matrix multiplication but a bunch of 1-dimensional dot products applied pointwise? why do we need matrices? I do get what you're saying, and that part of it is that ML / CS folk just use 'tensor' as a fancy word for a multi-dimensional array, whereas physics fol…

The traditional pure mathematical of looking at it is that vectors are members of a vector space. Matrices are linear maps, and matrix multiplication is composition of linear maps. So what algebraic concept do tensors correspond to?

Multilinear maps. You can view contraction with a vector (a dot product) as mapping a vector into the scalars, contraction with a matrix as mapping two vectors into the scalars, and contraction with a tensor as mapping several vectors into the scalars. You don't always have to contract all the indices at once, so with a rank m tensor, you can map n vectors into a collection of m - n vectors.

Re: TensorFlow: open-source library for machine intelligence

#189

Earlier quoted context omitted.

Why is alphabetical order great? It just only means that people with last names starting with z will get penalized every single time because of choosing wrong parents! I would think randomized order would be chosen - especially if you were mathematician.

"Choose" parents with a surname starting with A then.

You can also legally change your last name to anything you want at any point in time. If you care enough.

Or use a pseudonym.

Re: TensorFlow: open-source library for machine intelligence

#190
post #189

Earlier quoted context omitted.

"Choose" parents with a surname starting with A then.

You can also legally change your last name to anything you want at any point in time. If you care enough. Or use a pseudonym.

Meet Mr. Aaberg.
Post reply on HN