Anybody else get the sense that we're just totally frickin doomed? Even if Yudkowsky is off about AGI (which is a big maybe!) in what possible world will this technology be used to make our individual lives better (assuming you're not a FAIR researcher?)
Meta Unveils New AI Supercomputer
11–20 of 199 posts
Re: Meta Unveils New AI Supercomputer
#12I wonder if things like this are the real reason behind the GPU shortage. How many other AI super computers are being built right now?
I think these sorts of computers use special GPUs that are industrial and used specifically for AI/ML work. I don't believe they've powered the super computer with 3080s and I also don't think they use the same underlying chips either (albeit they are probably built with the same raw material that might be in short supply).
Re: Meta Unveils New AI Supercomputer
#13What is the difference between “a supercomputer” and “a bunch of racks of computers”?
The actual difference between the two is quite diminished compared to years past and seems to reduce more to how a collection of computers is used and not what it is.
Re: Meta Unveils New AI Supercomputer
#14I wonder if things like this are the real reason behind the GPU shortage. How many other AI super computers are being built right now?
You can probably look up who is TSMC manufacturing custom chips for since they’re public
Re: Meta Unveils New AI Supercomputer
#15How can they possibly keep the location of something like this a secret? There have to be thousands of people involved in building and maintaining it.
I don't see any sort of commitment to secrecy with this:
> The company declined to comment on the location of the facility or the cost
It's generally a common practice not to disclose addresses of your data centers, but they can usually be discerned with a bit of research. Journos aren't going to be that extensive.
Re: Meta Unveils New AI Supercomputer
#16All this to better predict behavior and present ads. What a waste.
Re: Meta Unveils New AI Supercomputer
#17I wonder if things like this are the real reason behind the GPU shortage. How many other AI super computers are being built right now?
Yes, lots of GPUs have been purchased to be installed in compute clusters since ~2009. The deep learning boom only increased that. At least these are not being used to mine cryptocoins...
Re: Meta Unveils New AI Supercomputer
#18I wonder if things like this are the real reason behind the GPU shortage. How many other AI super computers are being built right now?
I think these sorts of computers use special GPUs that are industrial and used specifically for AI/ML work. I don't believe they've powered the super computer with 3080s and I also don't think they use the same underlying chips either (albeit they are probably built with the same raw material that might be in short supply).
They take up chip fab capacity and that’s the bottleneck. The fact that it would be a custom die doesn’t really make a difference (and high level the features that go on the chip aren’t really all that different either, same stuff with various quantities and features tweaked)
Re: Meta Unveils New AI Supercomputer
#19I wonder if things like this are the real reason behind the GPU shortage. How many other AI super computers are being built right now?
I think these sorts of computers use special GPUs that are industrial and used specifically for AI/ML work. I don't believe they've powered the super computer with 3080s and I also don't think they use the same underlying chips either (albeit they are probably built with the same raw material that might be in short supply).
Good luck building special GPUs in just two years, especially with what's happening regarding chip production right now. Not sure how they could have achieved a project of this size/scope unless they use off-the-shelf components, since the backlogs are so long and have been for some time now.
Re: Meta Unveils New AI Supercomputer
#20How far can we actually take current machine learning technologies by scaling the underlying hardware? Are we going to see some AI algorithms that are 20% better or an order of magnitude better? And what will that realistically look like to an end user? This will have cost a lot of money and maybe the news alone will push stock prices and mean its paid for itself but is it actually going to result in a substantially…
I was just in a Twitter Spaces room and they have a live transcription feature, so as to be accessible and all, except the transcript was gibberish. If Facebook wants live translation in the Metaverse, they should hope this brings orders of magnitudes improvement to voice recognition, especially in languages other than english (by far the largest training set available)