Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Unveils New AI Supercomputer

wsj.com

Post reply on HN
Print view View original

81–90 of 199 posts

Re: Meta Unveils New AI Supercomputer

#81

Post by some_furry »

bearjaws wrote: post #5

“The experiences we’re building for the metaverse require enormous compute power…and RSC will enable new AI models that can learn from trillions of examples, understand hundreds of languages, and more,” Meta CEO Mark Zuckerberg I don't really understand how AI processing is going to make the 'experiences' any better? This seems to me like investor fluff, saying they have some insane capability that other 'VR provider…

Any Virtual Reality where I don't have the option of being a talking blue anthropomorphic dhole (i.e. my fursona) isn't one that I'll ever choose to adopt. Calling it a "metaverse" doesn't affect my decision here.

Re: Meta Unveils New AI Supercomputer

#83

Post by riazrizvi »

kleiba wrote: post #40

I used to work at a university where my professor had been in automatic speech recognition for a long time, but basically gave up on that line of research about 10 years ago because he figured that universities simply cannot compete budget wise with the big industry players. I suppose the same will soon be true for most ML-related areas of research sooner or later, at least as far as applied ML is concerned. Already,…

Academia is not necessarily the pinnacle of achievement in a field, it is the pinnacle of published achievement. There is always a dual track of proprietary knowledge, and knowledge available to the commons. Since the latter is most beneficial to society, that’s why we have awards for people when they publish their research, instead of hiding it for maximum profit.

I don’t see something new here, these institutions to encourage people to share are old, so it must be a problem that had been recognized for a while.

Re: Meta Unveils New AI Supercomputer

#84

Post by KaiserPro »

colechristensen wrote: post #13

What is the difference between “a supercomputer” and “a bunch of racks of computers”? The actual difference between the two is quite diminished compared to years past and seems to reduce more to how a collection of computers is used and not what it is.

This is a shared memory cluster. That is, there is some level of RDMA over a networking fabric.

Re: Meta Unveils New AI Supercomputer

#86

Post by edgyquant »

mindcrime wrote: post #78
chundicus wrote: post #62

I can't shake the feelings that a trillion or a quadrillion parameters won't solve the fundamental shortcomings of ML models not being models of artificial intelligence. I guess there's no way of knowing until we reach AGI, but I've never heard a compelling argument for why pure ML would get us there. GPT3 seems more like an argument against that hypothesis (in my view) than for it. Even the best, most expensive mode…

I've always imagined AGI (perhaps naively) as being achieved by clever usage of ML, plus some utilization of classical/symbolic AI from pre-AI winter days, plus probably some unknown elements. For what it's worth, this is my view as well. And I don't think it's particularly naive. Plenty of people have researched and/or are researching aspects of how to do this. But how to combine something like a neural network, wit…

Even if they did replicate how the brain works our brains aren’t one of these networks trained for specific things it is millions, maybe billions, of them combined.

Re: Meta Unveils New AI Supercomputer

#87

Post by Mageek »

kleiba wrote: post #40

I used to work at a university where my professor had been in automatic speech recognition for a long time, but basically gave up on that line of research about 10 years ago because he figured that universities simply cannot compete budget wise with the big industry players. I suppose the same will soon be true for most ML-related areas of research sooner or later, at least as far as applied ML is concerned. Already,…

Well, universities can’t compete in things like car production or rocket manufacturing but find ways to contribute nonetheless. Researchers have and always will struggle to get resources relative to BigCorp - AI is just joining the party. Daimler and Lockheed are no more open than Facebook is, AFAIK. There is still plenty to do and to analyze. Verifiable AI, more efficient models, knowledge transfer, 1000 brains, human interpretability, etc.

Re: Meta Unveils New AI Supercomputer

#88

Post by ModernMech »

yumraj wrote: post #65
colinmhayes wrote: post #50

Earlier quoted context omitted.

I don't see how this is a bad thing. What's wrong with preferring the metaverse to their sunny neighborhood? Honestly the matrix seems like the end game here and I'm all for it. Then it can be a sunny day in the neighborhood every day. The doom comes from the matrix being built by people who either don't have our best interests in mind, or aren't competent enough to build the system to correctly act in our best inter…

> The doom comes from the matrix being built by people who either don't have our best interests in mind ... You mean like Zuckerberg and FB?

What makes you believe that Mark "I can't believe those dumb fucks trust me" Zuckerberg doesn't have our best interests in mind?

Re: Meta Unveils New AI Supercomputer

#89

Post by Buttons840 »

exdsq wrote: post #9

How far can we actually take current machine learning technologies by scaling the underlying hardware? Are we going to see some AI algorithms that are 20% better or an order of magnitude better? And what will that realistically look like to an end user? This will have cost a lot of money and maybe the news alone will push stock prices and mean its paid for itself but is it actually going to result in a substantially…

I think these things scale sub-linearly

Re: Meta Unveils New AI Supercomputer

#90

Post by paxys »

kleiba wrote: post #40

I used to work at a university where my professor had been in automatic speech recognition for a long time, but basically gave up on that line of research about 10 years ago because he figured that universities simply cannot compete budget wise with the big industry players. I suppose the same will soon be true for most ML-related areas of research sooner or later, at least as far as applied ML is concerned. Already,…

Even historically, how much cutting-edge research for commercial tech has come from universities? I'd say government-backed labs, military and private corporations have all always had a greater impact.
Post reply on HN