21–30 of 30 posts
Earlier quoted context omitted.
Faster tensor transposition, which can speed up applications that do manipulation and calculation with tensors. Tensors are typically seen in physics.
For some reason, people use now the name "tensor" to refer to multidimensional arrays.
Earlier quoted context omitted.
Faster tensor transposition, which can speed up applications that do manipulation and calculation with tensors. Tensors are typically seen in physics.
For some reason, people use now the name "tensor" to refer to multidimensional arrays.
Earlier quoted context omitted.
Except that none of these operations are related to the properties that make a tensor a tensor, as far as I know. People were already operating happily on multidimensional arrays before.
"multidimensional array" doesn't quite roll off the tongue
Earlier quoted context omitted.
Faster tensor transposition, which can speed up applications that do manipulation and calculation with tensors. Tensors are typically seen in physics.
For some reason, people use now the name "tensor" to refer to multidimensional arrays.
Earlier quoted context omitted.
Probably for same reason as they use the name "vector" to refer one dimensional array, "matrix" to refer 2 dimensional array. Tensor is generalization of matrix to more than 2 indices. In physics people use tensor as a shorthand for tensor field.
> Probably for same reason as they use the name "vector" to refer one dimensional array, "matrix" to refer 2 dimensional array. Yes, that's where the rot started.
Earlier quoted context omitted.
For some reason, people use now the name "tensor" to refer to multidimensional arrays.
Quietly raising my hand that this bugged me too.
Now the part that always bugged me was that, at least in C++, a vector is an array that can change length, which is a very non-vectorial thing to do.
Earlier quoted context omitted.
Note that they only compared their solution with Eigen’s tensor transposition functionality. HPTT is not a drop-in replacement.
Does anyone know how much time a typical TensorFlow model spends in transposition routines?
Earlier quoted context omitted.
You might be familiar with more specific definition of tensors in physics where they come with full tensor calculus and transform in certain way. More general mathematical definition of tensor is that tensors are multilinear maps from vector spaces to scalars. That's how TensorFlow and HPTT see these tensors.
> More general mathematical definition of tensor is that tensors are multilinear maps from vector spaces to scalars. That's how TensorFlow and HPTT see these tensors. Oof, you have to squint very hard to see things that way. Just because an image is physically a two-dimensional array of pixels doesn't suddenly make it a rank-2 multilinear map, and just because you have N planes of images doesn't mean you suddenly hav…
Edit: source code is GPL licensed https://github.com/springer13/hptt
Would be fantastic if this could be contributed to numpy. Edit: source code is GPL licensed https://github.com/springer13/hptt