Live data from Hacker News

Google: Largest distributed training job for LLMs across 50000 TPU v5e

cloud.google.com

Post reply on HN

Print view View original

1–3 of 3 posts

Google: Largest distributed training job for LLMs across 50000 TPU v5e

Post by emu » Wed, Nov 08, 2023, 7:23 PM UTC

Google: Largest distributed training job for LLMs across 50000 TPU v5e
cloud.google.com

Re: Google: Largest distributed training job for LLMs across 50000 TPU v5e

Post by dekhn » Wed, Nov 08, 2023, 10:27 PM UTC

Tensorflow isn't even mentioned in the press release. I wonder if we can now conclude that Google is no longer promoting Tensorflow in Google Cloud (or any cloud) compared to Jax.

Re: Google: Largest distributed training job for LLMs across 50000 TPU v5e

Post by jeffbee » Fri, Nov 10, 2023, 1:24 AM UTC

199 feels like a really weird ultimate number of pods in service.

Post reply on HN