Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Unveils New AI Supercomputer

wsj.com

Post reply on HN
Print view View original

191–199 of 199 posts

Re: Meta Unveils New AI Supercomputer

#191

Post by mbrodersen »

chundicus wrote: post #62

I can't shake the feelings that a trillion or a quadrillion parameters won't solve the fundamental shortcomings of ML models not being models of artificial intelligence. I guess there's no way of knowing until we reach AGI, but I've never heard a compelling argument for why pure ML would get us there. GPT3 seems more like an argument against that hypothesis (in my view) than for it. Even the best, most expensive mode…

We are so far from having “real” AI that it is amusing to me every time I read yet another article gushing over ML. ML is fundamentally pattern matching. It is impressive tech for what it does. But humans doesn’t need 1 million carefully tagged images of chairs or cars to work out what a chair or car is. Our understanding of what general intelligent is hasn’t progressed much since the last AI winter. The only real difference is that computers are much faster today, enabling old technology ideas to be fast enough today for practical use.

Re: Meta Unveils New AI Supercomputer

#192

Post by benstrumental »

paxys wrote: post #116
benstrumental wrote: post #45

Earlier quoted context omitted.

> What is the difference between “a supercomputer” and “a bunch of racks of computers”? In addition to the other responses, I like pointing people to this talk[1] by Jeff Hammond for a comprehensive answer to this question (you can skip to the 11:15 timestamp). [1] https://uchicago.hosted.panopto.com/Panopto/Pages/Embed.aspx...

That talk is from 2009 though. Nowadays companies regularly run jobs on commercial data centers which can include thousands of GPU cores, Infiniband networking and other specialized equipment. One can make a pretty valid case that we are approaching the ability to make an ad-hoc supercomputer for yourself from the GCP console.

This talk was from April 2021. 2009 is the year he got his PhD[2].

[2] https://jeffhammond.github.io/

Re: Meta Unveils New AI Supercomputer

#193

Post by Atlas667 »

An AI that has free range to more profoundly study all the human data Facebook users generate?

That sounds wicked evil. If ads, marketing and habit inducing platform designs are a problem now, imagine what this will lead to.

To understand what drives your users more than the users understand it themselves and to use that understanding for profit. Intensified.

And not to mention for surveillance, you know DARPA and the NSA want their hands all over this.

Re: Meta Unveils New AI Supercomputer

#194

Post by vl »

dekhn wrote: post #180
vl wrote: post #94

Earlier quoted context omitted.

Honestly, this single GPU-based install is child's play compared to Google's multiple TPU exoflop supercomputers with hyper-cube optical interconnects. Google's ML setups allow synchronous weight update on thousand+ TPUs...

for TPUv3 it's 2D torus, not hyper-cube, right? Not sure if TPUv4 topology is externally published, but IIRC hypercubes are basically never used any more.

I mistyped, one version is 2D torus, next is 3D torus aka hypertorus.

Re: Meta Unveils New AI Supercomputer

#195

Post by Traubenfuchs »

doublerabbit wrote: post #131
Traubenfuchs wrote: post #60

Earlier quoted context omitted.

That would be a win-win for everyone.

Why?

VR enjoyers can enjoy VR, reality enjoyers can enjoy reality.

Vienna, where I am living, is completely overrun by people. Public spaces and transport at peak hours have become a mess in the last years. The first lockdown showed how beautiful the city can be if everyone stays home.

Re: Meta Unveils New AI Supercomputer

#196

Post by defaultprimate »

chundicus wrote: post #62

I can't shake the feelings that a trillion or a quadrillion parameters won't solve the fundamental shortcomings of ML models not being models of artificial intelligence. I guess there's no way of knowing until we reach AGI, but I've never heard a compelling argument for why pure ML would get us there. GPT3 seems more like an argument against that hypothesis (in my view) than for it. Even the best, most expensive mode…

We will never achieve AGI

Re: Meta Unveils New AI Supercomputer

#197

Post by lostmsu »

mFixman wrote: post #174
chundicus wrote: post #62

I can't shake the feelings that a trillion or a quadrillion parameters won't solve the fundamental shortcomings of ML models not being models of artificial intelligence. I guess there's no way of knowing until we reach AGI, but I've never heard a compelling argument for why pure ML would get us there. GPT3 seems more like an argument against that hypothesis (in my view) than for it. Even the best, most expensive mode…

AGI seems hard because each year more and more problems that were previously considered close to AGI are solved. Playing Chess at a grandmaster level was considered something only a human could do until the 1990s, and now no human has beat the best computer in 17 years while AGI seems further away than ever. Mark my words: we'll create an AI that can pass the Turing test this decade, but we'll still be as far away fr…

The chess example is not that strong: "the best computer" or more precisely the software that beats humans since 1990s was actually specifically designed to beat chess. That was the case until AlphaZero did the same in 2017 for the whole class of turn based games.

Re: Meta Unveils New AI Supercomputer

#198

Post by lostmsu »

lostmsu wrote: post #197
mFixman wrote: post #174

Earlier quoted context omitted.

AGI seems hard because each year more and more problems that were previously considered close to AGI are solved. Playing Chess at a grandmaster level was considered something only a human could do until the 1990s, and now no human has beat the best computer in 17 years while AGI seems further away than ever. Mark my words: we'll create an AI that can pass the Turing test this decade, but we'll still be as far away fr…

The chess example is not that strong: "the best computer" or more precisely the software that beats humans since 1990s was actually specifically designed to beat chess. That was the case until AlphaZero did the same in 2017 for the whole class of turn based games.

To add to that, it is quite possible that AlphaZero is already a general intelligence. Specifically, it may be that given some robotic manipulation, and some goals in real world, and lots and lots of tries (tens or hundreds of millions) it may beat an average human in "life".

Re: Meta Unveils New AI Supercomputer

#199

Post by mbrodersen »

mbrodersen wrote: post #191
chundicus wrote: post #62

I can't shake the feelings that a trillion or a quadrillion parameters won't solve the fundamental shortcomings of ML models not being models of artificial intelligence. I guess there's no way of knowing until we reach AGI, but I've never heard a compelling argument for why pure ML would get us there. GPT3 seems more like an argument against that hypothesis (in my view) than for it. Even the best, most expensive mode…

We are so far from having “real” AI that it is amusing to me every time I read yet another article gushing over ML. ML is fundamentally pattern matching. It is impressive tech for what it does. But humans doesn’t need 1 million carefully tagged images of chairs or cars to work out what a chair or car is. Our understanding of what general intelligent is hasn’t progressed much since the last AI winter. The only real di…

Wow so much downvoting. But no serious counter arguments.
Post reply on HN