Meta buys 600k H100s to train LLaMa3
twitter.com
Meta buys 600k H100s to train LLaMa3
1–10 of 16 posts
Re: Meta buys 600k H100s to train LLaMa3
#2I doubt they're paying retail prices like the tweet implies. Still can't be a small number if that is true.
Re: Meta buys 600k H100s to train LLaMa3
#3I should have built a video card company based on VAX designs.
Re: Meta buys 600k H100s to train LLaMa3
#4How many "parameters" for the LLaMa3?
Re: Meta buys 600k H100s to train LLaMa3
#5I doubt they're paying retail prices like the tweet implies. Still can't be a small number if that is true.
If there is a discount, it will be tiny:
> “We’re so short on GPUs the less people use our products the better… We’d love it if they use it less because we don’t have enough GPUs” — Sam Altman
> Meta who has the 2nd most H100 GPUs in the world is increasingly leveraging GPU supply as a recruiting strategy.
https://www.datagravity.dev/p/2023-year-in-review-the-great-...
Re: Meta buys 600k H100s to train LLaMa3
#6https://en.wikipedia.org/wiki/List_of_countries_by_GDP_(nomi...
lol, that's an investment!
Re: Meta buys 600k H100s to train LLaMa3
#7I doubt they're paying retail prices like the tweet implies. Still can't be a small number if that is true.
If there is a discount, it will be tiny: > “We’re so short on GPUs the less people use our products the better… We’d love it if they use it less because we don’t have enough GPUs” — Sam Altman > Meta who has the 2nd most H100 GPUs in the world is increasingly leveraging GPU supply as a recruiting strategy. https://www.datagravity.dev/p/2023-year-in-review-the-great-...
EXACTLY! what I was assuming.
Re: Meta buys 600k H100s to train LLaMa3
#8How many "parameters" for the LLaMa3?
zuck won't puck.
Re: Meta buys 600k H100s to train LLaMa3
#9I should have built a video card company based on VAX designs.
do it now.
Re: Meta buys 600k H100s to train LLaMa3
#10Wrong (it's 350K according to Zuck on insta) and dupe of "Meta will have more than 350.000 Nvidia H100s this year"[0], or "Zuckerberg's Meta Is Spending Billions to Buy 350k Nvidia H100 GPUs"[1]
[0]: https://news.ycombinator.com/item?id=39044911 [1]: https://news.ycombinator.com/item?id=39046193