Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Unveils New AI Supercomputer

wsj.com

Post reply on HN
Print view View original

151–160 of 199 posts

Re: Meta Unveils New AI Supercomputer

#151

Post by mrkramer »

reggieband wrote: post #118

I hate that I always end up referencing the Lex Friedman podcast but it is often relevant to discussion on HN. Recently Lex spoke with Yann LeCun and they had a brief chat about AI at Meta/Facebook [1] (where I believe Yann is currently Chief AI Scientist). He claims that AI is the core of Meta and that if you were to take ML out of Meta systems the company would literally crumble because it is completely built aroun…

There is no single AI company. These are all machine learning techniques. AI is spreadsheets on steroids not real intelligence.

Re: Meta Unveils New AI Supercomputer

#152

Post by mrkramer »

ddalex wrote: post #92
chundicus wrote: post #62

I can't shake the feelings that a trillion or a quadrillion parameters won't solve the fundamental shortcomings of ML models not being models of artificial intelligence. I guess there's no way of knowing until we reach AGI, but I've never heard a compelling argument for why pure ML would get us there. GPT3 seems more like an argument against that hypothesis (in my view) than for it. Even the best, most expensive mode…

I feel that for there are three requirements for a NN-based AGI, inspired by biology: a). an internal feedback loop that evaluates a possible output without actuating it, and self-modifies the parameters if the possible output is not what it's needed b). the capability (based on a) to model own behaviours without acting on them, and to model other agents behaviours and incorporate that model into the feedback c). the…

I doubt there will be AGI in our lifetime. Maybe some breakthrough happens but it won't be even close to human intelligence.

Re: Meta Unveils New AI Supercomputer

#153

Post by jeffbee »

ceejayoz wrote: post #91
ssully wrote: post #22

Earlier quoted context omitted.

Super computers are much larger than a few racks of GPU's.

You could fit any of the TOP500 machines into one of Facebook's datacenters, couldn't you? With room left over to spare? It's not like Facebook had to go hollow out the Moon to make this.

The largest machine in the top500 draws 30MW, which is getting to be close to the size of a Facebook or Google datacenter. All the rest are much smaller. Mostly people misunderstand the relationship between supercomputers and the cloud. Supercomputers are somewhat large and very specialized. Cloud datacenters are just enormous.

Re: Meta Unveils New AI Supercomputer

#154

Post by bduerst »

mrkramer wrote: post #152
ddalex wrote: post #92

Earlier quoted context omitted.

I feel that for there are three requirements for a NN-based AGI, inspired by biology: a). an internal feedback loop that evaluates a possible output without actuating it, and self-modifies the parameters if the possible output is not what it's needed b). the capability (based on a) to model own behaviours without acting on them, and to model other agents behaviours and incorporate that model into the feedback c). the…

I doubt there will be AGI in our lifetime. Maybe some breakthrough happens but it won't be even close to human intelligence.

I dunno. I didn't think consumer-common machine vision was achievable in our lifetimes either, yet everyone has a phone that can do it.

It's like all major tech breakthroughs - it seems impossible despite all the pieces being there, right up until someone puts them together.

Re: Meta Unveils New AI Supercomputer

#155

Post by LightG »

ctoth wrote: post #11

Anybody else get the sense that we're just totally frickin doomed? Even if Yudkowsky is off about AGI (which is a big maybe!) in what possible world will this technology be used to make our individual lives better (assuming you're not a FAIR researcher?)

Probably. I'm going to set up all my data so that, anytime it's parsed by Facebook, there'll be a middle-finger waiting for their supercomputer with just two words: "Process this".

Re: Meta Unveils New AI Supercomputer

#156

Post by lm28469 »

hooande wrote: post #113
ctoth wrote: post #11

Anybody else get the sense that we're just totally frickin doomed? Even if Yudkowsky is off about AGI (which is a big maybe!) in what possible world will this technology be used to make our individual lives better (assuming you're not a FAIR researcher?)

In theory, this could be used to create AI agents that can process visual/audio information in a way that's more similar to humans. It could lead to household robots or advanced conversational interfaces. or whatever the hell the metaverse is. It's just bunch of GPUs. It could be used for anything people can imagine, good or bad

Go back in time and tell people about the technical power we have in 2022. Then tell them to imagine what we do with it. And finally explain to them that the vast majority of it is used to sell us goods and services we mostly don't need.

Re: Meta Unveils New AI Supercomputer

#157

Post by knodi123 »

rileyphone wrote: post #122
ddalex wrote: post #92

Earlier quoted context omitted.

I feel that for there are three requirements for a NN-based AGI, inspired by biology: a). an internal feedback loop that evaluates a possible output without actuating it, and self-modifies the parameters if the possible output is not what it's needed b). the capability (based on a) to model own behaviours without acting on them, and to model other agents behaviours and incorporate that model into the feedback c). the…

https://www.creativemachineslab.com/uploads/6/9/3/4/69340277... "A robot modeled itself without prior knowledge of physics or its shape and used the self-model to perform tasks and detect self-damage."

lol, "the morphology was abruptly changed" is the most coldly scientific description of an injury I've ever heard.

Re: Meta Unveils New AI Supercomputer

#158

Post by knodi123 »

rococode wrote: post #70
kleiba wrote: post #40

I used to work at a university where my professor had been in automatic speech recognition for a long time, but basically gave up on that line of research about 10 years ago because he figured that universities simply cannot compete budget wise with the big industry players. I suppose the same will soon be true for most ML-related areas of research sooner or later, at least as far as applied ML is concerned. Already,…

I think the academic side will start shifting towards research on efficiency and speed while companies will continue to push the cutting edge. In the NLP space there's been a lot of work recently around reducing model sizes, since they've started to reach the point where model weights sometimes don't fit in the memory of most GPUs. There's also projects like MarianNMT which completely abandon Python and write heavily…

> I think the academic side will start shifting towards research on efficiency and speed

Constraints are the mother of creativity.

Re: Meta Unveils New AI Supercomputer

#159

Post by 6gvONxR4sf7o »

reggieband wrote: post #118

I hate that I always end up referencing the Lex Friedman podcast but it is often relevant to discussion on HN. Recently Lex spoke with Yann LeCun and they had a brief chat about AI at Meta/Facebook [1] (where I believe Yann is currently Chief AI Scientist). He claims that AI is the core of Meta and that if you were to take ML out of Meta systems the company would literally crumble because it is completely built aroun…

I haven't listened to the podcast, but the way I read a statement like that is, "Our business needs to do things that aren't as simple as defining manual rules, but the economics of our business prevents us from just paying people to do those things at scale."

Re: Meta Unveils New AI Supercomputer

#160

Post by knodi123 »

hooande wrote: post #113
ctoth wrote: post #11

Anybody else get the sense that we're just totally frickin doomed? Even if Yudkowsky is off about AGI (which is a big maybe!) in what possible world will this technology be used to make our individual lives better (assuming you're not a FAIR researcher?)

In theory, this could be used to create AI agents that can process visual/audio information in a way that's more similar to humans. It could lead to household robots or advanced conversational interfaces. or whatever the hell the metaverse is. It's just bunch of GPUs. It could be used for anything people can imagine, good or bad

> It could lead to household robots or advanced conversational interfaces.

Yes, but anything that could do that, will be used for military robots and context-aware ubiquitous comms surveillance.

> It's just bunch of GPUs. It could be used for anything people can imagine, good or bad

And nuclear power can be used for good or ill, too. But when the ills grow big enough, it's still fair to worry about proliferation and possible end-of-civilization events. It's unhelpful to reassure someone building a bomb bunker "Don't worry, nuclear power is just a tool, it can be used for good OR for bad".

Post reply on HN