Earlier quoted context omitted.
A whole butt ton of GPU-style FMA and low precision float multiply ALUs would be my guess
How low precision can you get and still have it be useful?
Google's TPU proves that 8 bits is still good.
Second version of HoloLens HPU will incorporate AI coprocessor
71–80 of 93 posts
Re: Second version of HoloLens HPU will incorporate AI coprocessor
#72Re: Second version of HoloLens HPU will incorporate AI coprocessor
#73Any idea who makes it? It's probably close in architecture to GPUs, the kind of thing Nvidia and AMD are positioned to capitalise on.
They used customizable DSPs from Tensilica. I wonder if this is based on the same technology.
You're right, Microsoft revealed last year in a Hot Chips presentation that HPU v1 is a Cadence Tensilica DSP with custom instructions [1]. Given that, I'd bet that HPU v2's neural net core is Cadence's "Vision C5" [2].
[1] http://www.tomshardware.com/news/microsoft-hololens-hpu-arch...
[2] https://www.cadence.com/content/cadence-www/global/en_US/hom...
Re: Second version of HoloLens HPU will incorporate AI coprocessor
#74Re: Second version of HoloLens HPU will incorporate AI coprocessor
#75Earlier quoted context omitted.
Have you actually used it? I have it on my desk. It's garbage. Low res, narrow FoV display, graphics capabilities from 10 years ago. I wouldn't pay fifty bucks for it if I was spending my own money.
I have used one and everything you said is valid. It is fairly low res and the graphics are mobile quality, but that isn't what you are paying for, and calling it garbage is pretty unfair. Show me another device that is doing AR right now at the fidelity levels of HL. Your criticism is the equivalent of comparing an iPhone with a full on desktop workstation. They are not trying to solve the same problem and therefore…
> They are not trying to solve the same problem and therefore do not need to have the same visual fidelity.
I think they are trying to solve the same problem. I'd love a desktop AR headset. They do need the same visual fidelity, we're just not there yet. I'm patient :)
Re: Second version of HoloLens HPU will incorporate AI coprocessor
#76Earlier quoted context omitted.
Altera, an Intel subsidiary. [1] 1. https://www.bloomberg.com/news/articles/2017-07-24/quest-for...
Microsoft are using Intel/Altera FPGAs in the datacenter, and not likely for mass produced devices like this. While it is possible they are using FPGAs for the Hololens Processing Unit, I seriously doubt it. The FPGA needed to exceed the performance of a high-end mobile GPU (OpenCL/CUDA for Deep Learning/AI) would have an excessive power consumption for a mobile device. Another factor is that higher end FPGAs are exp…
I have a friend at Intel who works in the AR division and their comment to me is that in one way or another all AR/MR glasses are running Intel silicon. I asked them specifically, does that include, Hololens, Apple's Project, and a couple others specifically, and they answered in the affirmative. YMMV though.
Re: Second version of HoloLens HPU will incorporate AI coprocessor
#77Earlier quoted context omitted.
The use cases are pretty varied. We're using some for a medical study looking to see if the HL can help lessen pain through distraction (tested against normal distractions like iPads). The HL is nice, as it lessens incidents of simulator sickness. We're also trying to get the thing to be used to scan the homes and backyards of long-term stay patients so that they can 'go back home' for a little bit while hooked into…
The virtual home sounds more appropriate for VR than AR or am I missing something about the in hospital scenario - with AR you'd still see all the hospital just with some bright holograms trying to be "in front"
You know, I've never been able to pin down what the difference is between AR and VR, everyone has a different answer. Basically, yes, we'd use the non HL ones for 'home' visits while in the hospital, if the kids can handle the nausea (they tend to be on a lot of meds, things get complicated). Again, the 'hacker ethos' doesn't really work in a hospital, moving fast and breaking things is a no-go with the Hippocratic oath.
Re: Second version of HoloLens HPU will incorporate AI coprocessor
#78Earlier quoted context omitted.
The virtual home sounds more appropriate for VR than AR or am I missing something about the in hospital scenario - with AR you'd still see all the hospital just with some bright holograms trying to be "in front"
Turn the lights off?
haha, if only you could.
Re: Second version of HoloLens HPU will incorporate AI coprocessor
#79Re: Second version of HoloLens HPU will incorporate AI coprocessor
#80Earlier quoted context omitted.
Microsoft are using Intel/Altera FPGAs in the datacenter, and not likely for mass produced devices like this. While it is possible they are using FPGAs for the Hololens Processing Unit, I seriously doubt it. The FPGA needed to exceed the performance of a high-end mobile GPU (OpenCL/CUDA for Deep Learning/AI) would have an excessive power consumption for a mobile device. Another factor is that higher end FPGAs are exp…
I have a friend at Intel who works in the AR division and their comment to me is that in one way or another all AR/MR glasses are running Intel silicon. I asked them specifically, does that include, Hololens, Apple's Project, and a couple others specifically, and they answered in the affirmative. YMMV though.
Its possible it could be Intel silicon, just not a Altera FPGA.