So what is that IPU exactly? Lots of buzzwords but few actual details about the architecture. Is it like a integer GPU? The massive amount of ALUs suggests something like that. But later, I see "Notably, because Pixel Visual Core is programmable, we’re already preparing the next set of applications.". So, is it FPGA-like?
It's an Image Processing Unit. Architecturally I'd expect it to look like a GPU, maybe with something like the new matrix-multiply unit from their TPU. https://www.slideshare.net/AntoniosKatsarakis/tensor-process... Edit: wrong name
Pixel Visual Core: Google’s first custom-designed co-processor
61–70 of 102 posts
Re: Pixel Visual Core: Google’s first custom-designed co-processor
#62Earlier quoted context omitted.
BUT it is HDR aka they take multiple of photos and use the under exposed for the sky and the more exposed for the faces. So they are doing MUCH more then a histogram.
Sure, but why even do that if a histogram stretch achieves what is effectively the same end result?
Re: Pixel Visual Core: Google’s first custom-designed co-processor
#63Earlier quoted context omitted.
BUT it is HDR aka they take multiple of photos and use the under exposed for the sky and the more exposed for the faces. So they are doing MUCH more then a histogram.
Sure, but why even do that if a histogram stretch achieves what is effectively the same end result?
Re: Pixel Visual Core: Google’s first custom-designed co-processor
#64It seems odd to me that Samsung isn't doing things like this. After all they have both the chip design talent in house, they design their own Eynos chips, and even have the fabs in house as well. They're not as well regarded for software, but they do at least have some in house dev capability. A Samsung Galaxy with that sort of differentiation would, like this phone, make even a die hard iPhone user like me take seri…
Google has ML experts, compiler experts, etc. who probably contributed a lot to this. I guess it is a perk of keeping domain experts in the company who are there to advise when time comes.
Re: Pixel Visual Core: Google’s first custom-designed co-processor
#65Earlier quoted context omitted.
I'm not so sure... Have they bought or hired any taken like apple did?
You're begging the question here. Apple's acquisition of PA Semi filled a void. You assume a similar void.
Re: Pixel Visual Core: Google’s first custom-designed co-processor
#66Earlier quoted context omitted.
My mistake, I phrased my question incorrectly. Why not opencv with a halide backend. The tensorflow whitepaper compares the TF ir to the halide ir. In fact, the work in tensorflow core is around XLA https://www.tensorflow.org/performance/xla/ (which brings compatibility across various architecture) It seems that this is more an attempt at locking the tensors to target custom metal, so that it can't be copied and made…
Halide is much more flexible. OpenCV is a fixed high level toolbox, combining things requires lots of intermediate buffers. Halide allows compiling arbitrary kernels in a fused way with extremely good performance. Sure you could implement OpenCV functions using Halide, but better to expose the lower level more flexible API. Source: I’ve rewritten parts of an OpenCV app in Halide for performance. Also your argument th…
I find it telling that they compared cpu vs tpu... Not GPU vs tpu.
Re: Pixel Visual Core: Google’s first custom-designed co-processor
#67Re: Pixel Visual Core: Google’s first custom-designed co-processor
#68On the plus side, the co-processor seems programmable, which means quality can improve without the need to upgrade the hardware.
Re: Pixel Visual Core: Google’s first custom-designed co-processor
#69It seems odd to me that Samsung isn't doing things like this. After all they have both the chip design talent in house, they design their own Eynos chips, and even have the fabs in house as well. They're not as well regarded for software, but they do at least have some in house dev capability. A Samsung Galaxy with that sort of differentiation would, like this phone, make even a die hard iPhone user like me take seri…
I'm not sure if they have the software dev capability. Sure, they make nice UIs/apps on top of Android, but what about core computer science and domain specific skills? The new OS they tried to make was apparently full of kernel level bugs. Google has ML experts, compiler experts, etc. who probably contributed a lot to this. I guess it is a perk of keeping domain experts in the company who are there to advise when ti…