Live data from Hacker News

Benchmarking Google’s new TPUv2

blog.riseml.com

91–95 of 95 posts

Re: Benchmarking Google’s new TPUv2

#91
post #76
post #33

Earlier quoted context omitted.

That's why you scroll down the page to the cost comparison, which places it on a more even keel. They do also compare float16 on Volta. Physical packaging is irrelevant -- what matters is dollars to convergence and time to convergence. (I'm obviously biased - I helped with parts of the cloud-side of cloud TPU - but I presume this comment stands on its own. :-)

To be clear, I had read the whole post, I was just being terse since the emphasis seemed to be so heavily on an apples to bananas comparison (I believe 100% of the results cited in the prose, many in bold, are with mismatched precision and batch size), with minimal articulation of the many axes of nuance here. Precision isn't defined at all in the LSTM case, and could easily be the cause of the failure of the TPU run…

Thank you for your feedback! (author here)

Our intention is really to provide a sound comparison. I think we agree that these kinds of comparisons can be hard given the constraints (e.g., lack of available technical information on TPUv2 or public implementations of optimized models for certain architectures). As I stated elsewhere, we are collecting all of the feedback and will run additional experiments.

If you know of an implementation of a mixed-precision/fp16 model that you'd like to see results for, please let us know! I may also reach out directly to you for that if you don't mind.

Re: Benchmarking Google’s new TPUv2

#92
post #49

Earlier quoted context omitted.

So this is a chip that no one outside of Google is going to be able to get a physical copy of ever? It makes any benchmarks become Google-cloud benchmarks, right? Edit: I am complaining a bit about the lack of availability but there's also a real point here. If there's no source for TPUs outside of Google, Google Cloud competes only with other cloud providers and with owning physical GPUs - long term, it has no incen…

It's going to be a very exciting multi-company arms race -- at minimum, Google, Intel, Nvidia. Microsoft has their FPGAs, Amazon has their rumors. And there are several startups trying to enter the space. I don't think we're looking at stagnating; very much the opposite. It's going to be fantastic for the field. (I'm saying this with my CMU hat, not my Google hat.)

What are the Amazon rumors?

Re: Benchmarking Google’s new TPUv2

#93

Earlier quoted context omitted.

> Google is the same as NSA, but exists as a dance around 4th amendment You are a conspiracy theorist. > Google can do the sort of spying the US government can't constitutionally do, then hand that over to the government, constitutionally This is an agenda-driven redefinition of the word "spy" that I find disingenuous in the extreme. > It's all stagecraft. Same for Apple, Amazon, Intel, etc. Eric Schmidt runs HRCs ca…

Only on HN does a conspiracy theory get shut down with “I once worked with Al Gore...” :)

He works with KP so it's not that unusual. He even tweeted about my product!

Re: Benchmarking Google’s new TPUv2

#94
post #51

Google claim 29x better performance-per-Watt with TPUs than contemporary GPUs[0]. Interesting to contrast that to the images-per-$ figure in this post, which is more like 2x. I assume there's a high capital cost for this new hardware, but when they scale it up I wonder if the ratio of cost TPU to GPU will trend towards the ratio of power-per-Watt between the platforms? Seems like a natural limit, even if it never qui…

Maybe Google will pivot from high tech into crypto mining

[deleted]

Re: Benchmarking Google’s new TPUv2

#95
post #49

Earlier quoted context omitted.

It's going to be a very exciting multi-company arms race -- at minimum, Google, Intel, Nvidia. Microsoft has their FPGAs, Amazon has their rumors. And there are several startups trying to enter the space. I don't think we're looking at stagnating; very much the opposite. It's going to be fantastic for the field. (I'm saying this with my CMU hat, not my Google hat.)

What are the Amazon rumors?

https://www.google.com/amp/s/www.theverge.com/platform/amp/2...

The (expensive) report from The Information upon which that article was based speculates a little more about chips for training.

Post reply on HN