Live data from Hacker News

The Looming Battle Over AI Chips

barrons.com

41–50 of 89 posts

Re: The Looming Battle Over AI Chips

#41
post #25

Do people think that nobody at nVidia has ever heard of specialized deep learning processors? 1. Volta GPUs already have little matmul cores, basically a bunch of little TPUs. 2. The graphics dedicated silicon is an extremely tiny portion of the die, a trivial component (source: Bill Dally, nVidia chief scientist). 3. Memory access power and performance is the bottleneck (even in the TPU paper), and will only continu…

And Intel knew that mobile chips will one day become very popular, too - two decades ago. Much good did that knowledge do to the company. It's not about them being ignorant about it. It's about them making decisions in spite of that knowledge - decisions that Make Sense™ for the advancement and increased profitability of the incumbent cash cow, but they are often contradictory or have a negative impact on new tech in…

Great point. Intel tried to break into the mobile and graphics market for sooo long with no success.

I do hope the AI specific TPUs that come out on the future will follow the ARM model instead of being silod into proprietary architectures. Fucking hate the vendor lock in of NVIDIA with CUDA.

Re: The Looming Battle Over AI Chips

#42

Nvidia will almost certainly respond to this challenge with it's own specialized machine learning and inference chips. It's probably what Google, Facebook and others hope. Forcing Nvidia to work harder is enough for them. Developing a new high performance microarchitecture for GPU or CPU is complex task. A new clean sheet design architecture takes 5-7 years even for teams that have been doing it constantly for decade…

Do not see why Google would care what Nvidia is doing? Why would they?

> Do not see why Google would care what Nvidia is doing? Why would they?

But without the data and not doing higher layers of the stack how can Nvidia create a product that is competitive with the TPUs for inference?

Re: The Looming Battle Over AI Chips

#44
post #5

I just seem to bump into a paywall. The premise from the title seems plausible, although NVIDIA seems to be catching up again fast.

use the web button at the top - worked for me

Doesn't work on an ipad. Barrons fades out the text, trivializing themselves to non subscribers.

Re: The Looming Battle Over AI Chips

#45

If you're FB, GOOG, AAPL, AMZN, BIDU, etc, this strategy makes sense because much like they have siloed data, they also have siloed computation graphs for which they can lovingly design artisan transistors to make the perfect craft ASIC. There's big money in this. Or you can be like BIDU, buy 100K consumer GPUs, and put them in your datacenter. In response, Jensen altered the CUDA 9.1 licensing agreement and the EULA…

FYI I think your comment is informative and I understood a lot of it but that's a shitton of acronymns for the uninitiated.

Most are stock ticker names from the NYSE

Re: The Looming Battle Over AI Chips

#46

If you're FB, GOOG, AAPL, AMZN, BIDU, etc, this strategy makes sense because much like they have siloed data, they also have siloed computation graphs for which they can lovingly design artisan transistors to make the perfect craft ASIC. There's big money in this. Or you can be like BIDU, buy 100K consumer GPUs, and put them in your datacenter. In response, Jensen altered the CUDA 9.1 licensing agreement and the EULA…

s /Jensen / nvidia ?

Re: The Looming Battle Over AI Chips

#47

Earlier quoted context omitted.

It probably won't. For every oppressive move NVDA has made so far, there has been a swarm of low-information technophobe MBA sorts who eat their computational agitprop right up, some of them even fashion themselves as data scientists. More likely, NVDA continues becoming the Oracle of AI that everyone needs and everyone hates.

So is OpenCL dead? Because that's how everyone is talking. The tools you choose, and their licensing, matters!

Almost as dead as its original creator, Steve Jobs, who only summoned it into existence because Jensen Huang leaked a deal between AAPL and NVDA ahead of him.

OpenCL could have been killer on mobile, and it could have delivered low-power machine learning and computation there all the way back in 2012, but both AAPL and GOOG went out of their way to cripple its use despite many of the mobile GPUs having hardware support for it. We all lost there IMO.

Re: The Looming Battle Over AI Chips

#48

Earlier quoted context omitted.

It probably won't. For every oppressive move NVDA has made so far, there has been a swarm of low-information technophobe MBA sorts who eat their computational agitprop right up, some of them even fashion themselves as data scientists. More likely, NVDA continues becoming the Oracle of AI that everyone needs and everyone hates.

So is OpenCL dead? Because that's how everyone is talking. The tools you choose, and their licensing, matters!

When I looked at OpenCl, my impression was it was simply a kind of bundle of functionality that happened to be shared by different GPUs (thin-layer of syntax on top of each manufacturers chip) whereas Cuda is a library that actually shields the programmer from the complexity of programming a GPU. I think AMD is working on an open-source system somewhat equivalent to Cuda which might be nice to see develop. But it seems like the OpenCl consortium is the kind of organization that could never care about the individual developer or meet their needs. I'd love if someone could prove me wrong.

Re: The Looming Battle Over AI Chips

#49

Nvidia, moreover, increasingly views its software for programming its chips, called CUDA, as a kind of vast operating system that would span all of the machine learning in the world, an operating system akin to what Microsoft (MSFT) was in the old days of PCs. Yeah, nVidia throwing it's weight around in terms of requiring that data centers pay more to use cheap consumer gaming chips may turn out to backfire and certa…

NVidia have had similar dodgy tactics in the past, including blocking their GPUs from being used in a VM using IOMMU. For my use case (where I had Windows in a VM on a Linux host) this was a massive PITA.

Re: The Looming Battle Over AI Chips

#50

Nvidia will almost certainly respond to this challenge with it's own specialized machine learning and inference chips. It's probably what Google, Facebook and others hope. Forcing Nvidia to work harder is enough for them. Developing a new high performance microarchitecture for GPU or CPU is complex task. A new clean sheet design architecture takes 5-7 years even for teams that have been doing it constantly for decade…

[deleted]
Post reply on HN