Earlier quoted context omitted.
More people trapped inside on the metaverse = smaller crowds at outdoor recreation areas?
That would be a win-win for everyone.
Why?
Meta Unveils New AI Supercomputer
131–140 of 199 posts
Re: Meta Unveils New AI Supercomputer
#132“The experiences we’re building for the metaverse require enormous compute power…and RSC will enable new AI models that can learn from trillions of examples, understand hundreds of languages, and more,” Meta CEO Mark Zuckerberg I don't really understand how AI processing is going to make the 'experiences' any better? This seems to me like investor fluff, saying they have some insane capability that other 'VR provider…
In the past they've used machine learning to do a kind of blurring I can't remember the name of to make scenes in VR look more realistic. They are building a lot of ML models. I think the future of VR is almost intertwined with machine learning.
Re: Meta Unveils New AI Supercomputer
#133Earlier quoted context omitted.
I think these sorts of computers use special GPUs that are industrial and used specifically for AI/ML work. I don't believe they've powered the super computer with 3080s and I also don't think they use the same underlying chips either (albeit they are probably built with the same raw material that might be in short supply).
They take up chip fab capacity and that’s the bottleneck. The fact that it would be a custom die doesn’t really make a difference (and high level the features that go on the chip aren’t really all that different either, same stuff with various quantities and features tweaked)
They take up chip capacity on different fab. You can't produce gaming Ampere on TSMC. They are built on different architectures that have only name in common. The difference between "Ampere" and "Ampere" is bigger than between Volta and Turing, or maybe even than difference between Pascal and Turing.
Re: Meta Unveils New AI Supercomputer
#134I hate that I always end up referencing the Lex Friedman podcast but it is often relevant to discussion on HN. Recently Lex spoke with Yann LeCun and they had a brief chat about AI at Meta/Facebook [1] (where I believe Yann is currently Chief AI Scientist). He claims that AI is the core of Meta and that if you were to take ML out of Meta systems the company would literally crumble because it is completely built aroun…
These aren't startups trying to prove "AI Purity" for more funding. These are money printers that are optimizing how to print more money. And Facebook and Google are competing against each other for online advertising dollars (yes, the pie is also growing). Their revenues are up 60% and 40% over the past 2 years, so I doubt their AI plays are just about proving some purity game.
Re: Meta Unveils New AI Supercomputer
#135“The experiences we’re building for the metaverse require enormous compute power…and RSC will enable new AI models that can learn from trillions of examples, understand hundreds of languages, and more,” Meta CEO Mark Zuckerberg I don't really understand how AI processing is going to make the 'experiences' any better? This seems to me like investor fluff, saying they have some insane capability that other 'VR provider…
Creating a 3D world with limited amount of data.
Re: Meta Unveils New AI Supercomputer
#136I can't shake the feelings that a trillion or a quadrillion parameters won't solve the fundamental shortcomings of ML models not being models of artificial intelligence. I guess there's no way of knowing until we reach AGI, but I've never heard a compelling argument for why pure ML would get us there. GPT3 seems more like an argument against that hypothesis (in my view) than for it. Even the best, most expensive mode…
I'd say that the view against ANN gives humans (especially researchers) more "dignity", in the sense that we still need to figure out some deep stuff and not just add hardware. I wouldn't treat this as an argument either way, just an observation. Heuristically, we came to be by a very dumb process of piling up newer generations. If my pet would communicate with me on the level of GPTx, I would be very impressed. That…
> If my pet would communicate with me on the level of GPTx, I would be very impressed.
GPTx is not communicating with anyone. It is generating text that resembles text it had in its training set. The fact that human text is normally a form of communication doesn't make generating quasi-random text communication in itself. GPTx is no more communicating than a printer is when printing out text.
A cat or dog leading you to their empty food bowl is actual communication, and they are capable of much more advanced communication as well (especially dogs). The fact that it doesn't look like written text is not that relevant. They are of course worse than GPTx at producing text, just like they are worse than a printer at writing it on a blank page.
Re: Meta Unveils New AI Supercomputer
#137Anybody else get the sense that we're just totally frickin doomed? Even if Yudkowsky is off about AGI (which is a big maybe!) in what possible world will this technology be used to make our individual lives better (assuming you're not a FAIR researcher?)
More people trapped inside on the metaverse = smaller crowds at outdoor recreation areas?
I think the real world will become populated with android avatars which are controlled by people from their VR headsets.
So you’ll have small human crowds but loads of anonymous avatar androids taking all the good fishing spots, riding the trails backwards, etc.
I’m joking hopefully
Re: Meta Unveils New AI Supercomputer
#138Could this have been the reason for chip shortage?
Nvidia and AMD shipped 12.7m cards collectively in 2021, I don't know what the breakdown is on consumer vs corporate but I find it hard to believe this had any impact. Correction: terafo pointed out they shipped 12.7m cards in Q3 2021 alone.
It was not 12.7 million in 2021. It was 12.7 million in Q3 2021.
Re: Meta Unveils New AI Supercomputer
#139Could this have been the reason for chip shortage?
Re: Meta Unveils New AI Supercomputer
#140Earlier quoted context omitted.
Nvidia and AMD shipped 12.7m cards collectively in 2021, I don't know what the breakdown is on consumer vs corporate but I find it hard to believe this had any impact. Correction: terafo pointed out they shipped 12.7m cards in Q3 2021 alone.
It was not 12.7 million in 2021. It was 12.7 million in Q3 2021.
Where did you see that? This was my source:
https://www.digitaltrends.com/computing/gpu-shipments-increa...
"Nvidia and AMD shipped 12.7 million cards in 2021"
Please correct me if I'm misreading or clearly missing something.