From what I gather online, intel is entering into an exestential crisis as homegrown chips and GPUs are replacing CPUs in the battle for tomorrow's data center. All of the interesting research from Google and others all have one thing in common: a custom asic processor.
custom asic processor Is that like La Brea Tarpit ? Just say ASIC. An ASIC is an Application Specific Integrated Circuit . In particular, a GPU is not an ASIC. Saying Custom Application Specific Integrated Circuit Processor is doubly redundant. https://en.wikipedia.org/wiki/Application-specific_integrate... https://en.wikipedia.org/wiki/Graphics_processing_unit
Intel Discontinues the Intel Developer Forum; IDF17 Cancelled
71–80 of 201 posts
Re: Intel Discontinues the Intel Developer Forum; IDF17 Cancelled
#72I'm wondering why Intel is withdrawing so much of their money from different projects like this and OpenStack. Maybe AMD is putting a lot of financial pressure on them, and they have to put more funds in R&D?
Re: Intel Discontinues the Intel Developer Forum; IDF17 Cancelled
#73From what I gather online, intel is entering into an exestential crisis as homegrown chips and GPUs are replacing CPUs in the battle for tomorrow's data center. All of the interesting research from Google and others all have one thing in common: a custom asic processor.
The ASIC processors Google use are for inference , not training. Having efficient inference is great, but training is what uses up most of the compute power. The battle between GPUs and CPUs in the datacenter is real, but I wouldn't count out regular CPUs yet. Even with GPU-ready frameworks like Tensorflow, Theano, and Pytorch, it still requires a fair amount of domain expertise to get good performance out of GPUs. T…
Re: Intel Discontinues the Intel Developer Forum; IDF17 Cancelled
#74Earlier quoted context omitted.
The ASIC processors Google use are for inference , not training. Having efficient inference is great, but training is what uses up most of the compute power. The battle between GPUs and CPUs in the datacenter is real, but I wouldn't count out regular CPUs yet. Even with GPU-ready frameworks like Tensorflow, Theano, and Pytorch, it still requires a fair amount of domain expertise to get good performance out of GPUs. T…
Correction: the ASIC processors that Google used in 2015 and just talked about, two years later, were for inference. We don't know what they use now and how. The paper hints that training might happen in a later revision. You have to wonder why they started with inference and not the other way round. Perhaps it's the case that you train a model once, then use it for predictions many, many, many times, thus using more…
At least from what I know of ASICs (which is admittedly pretty high-level), this direction is the natural way I'd expect it to go, because the inference problem is much closer in scale to the kind of problem ASICs are already widely used for and good at. Fast inference can be done with a chip of a size similar to what you see in existing ASICs, like specialized DSP chips. Speeding up training is a lot more speculative. You could try scaling up to massively powerful individual chips that can each replace an NVidia GPU (but with lower cost / lower power budget), or improve distributed training so you can effectively use a much larger number of much weaker customized chips. And there are more significant memory and memory-bandwidth issues with training, so it's less of the pure-compute type of problem that ASICs are more often clear wins for. All of which is probably possible with enough effort, but less straightforward, especially to end up with something that beats GPUs on relevant metrics.
Re: Intel Discontinues the Intel Developer Forum; IDF17 Cancelled
#75Earlier quoted context omitted.
Atoms are too big, photons are too big, electrons are too big, and the speed of light is too slow. There's no longer plenty of room at the bottom. Still, it's not like the physical size of semiconductors is the problem. A CPU today is maybe 100mm^2 of silicon. 4U of rack space can easily hold tens of thousands of CPUs, if you can power them, cool them, and connect them up in a useful way.
if you can power them, cool them, and connect them up in a useful way. Good luck with that. Power costs go up linearly at best with cores if you don't have any more transistor scaling.
Actually useful reversible logic is, as they say, an open problem.
Re: Intel Discontinues the Intel Developer Forum; IDF17 Cancelled
#76Earlier quoted context omitted.
if you can power them, cool them, and connect them up in a useful way. Good luck with that. Power costs go up linearly at best with cores if you don't have any more transistor scaling.
Power will always scale linearly with cores, of course, but you could make cores less power-hungry with reversible computing: https://en.wikipedia.org/wiki/Reversible_computing Actually useful reversible logic is, as they say, an open problem.
Re: Intel Discontinues the Intel Developer Forum; IDF17 Cancelled
#77Android as an OS surpassing this March everything else on web-usage speaks the same story in different words (http://www.wired.co.uk/article/android-overtakes-windows).
Re: Intel Discontinues the Intel Developer Forum; IDF17 Cancelled
#78Earlier quoted context omitted.
You forgot that Intel bought Nervana Systems last year, right before IDF. They develop custom ASIC processors for machine learning.
Which doesn't necessarily mean anything for Intel's future in machine learning. Intel bought an ARM chip maker before, too, and because of internal conflict of interest with the x86 group, it ended-up killing the ARM division. Will the same happen to other non-x86 groups? Who knows. But we also see that even Intel's previous "accelerator" divisions have moved focus to being "CPU-driven" as well (Xeon Phi), so we have…
reminds Sun in 1998 and the onward years when SPARC was like North Korea border patrol in preventing any x86 penetration into Sun even though it was clear that x86 was the future.
Re: Intel Discontinues the Intel Developer Forum; IDF17 Cancelled
#79Anybody know if and when desktop CPU's might start getting FPGAs? Been waiting for that for a while now...
For the desktop, though? Not for a while.
Re: Intel Discontinues the Intel Developer Forum; IDF17 Cancelled
#80Anybody know if and when desktop CPU's might start getting FPGAs? Been waiting for that for a while now...
http://www.eweek.com/servers/intel-begins-shipping-xeon-chip... For the desktop, though? Not for a while.