Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Unveils New AI Supercomputer

wsj.com

Post reply on HN
Print view View original

161–170 of 199 posts

Re: Meta Unveils New AI Supercomputer

#161

Post by 6gvONxR4sf7o »

rawtxapp wrote: post #100
vl wrote: post #94

Earlier quoted context omitted.

Honestly, this single GPU-based install is child's play compared to Google's multiple TPU exoflop supercomputers with hyper-cube optical interconnects. Google's ML setups allow synchronous weight update on thousand+ TPUs...

TPUs are amazing, but in my experience, debugging issues with them can be a bit tricky. Since nvidia's gpus are more common place (especially outside gcp), you can find a lot more information when you get stuck, it's also more battle tested, etc.

For what it's worth, jax is helpful to me here. You can drop out of the jit to debug it as if it were numpy.

Of course that assumes your issues aren't with the jit itself or inside pmap, etc. That shit's hard.

Re: Meta Unveils New AI Supercomputer

#163

Post by edgyquant »

penjelly wrote: post #38

it feels like the future of companies is to increasingly give tasks to AI. So eventually we'll have massive corps that have a couple execs and a super ai making them all obscenely rich? I want to hate this idea, but it would be the same as hating machines replacing manual labor over the last 100 years. im not sure what to think, nor how to prepare myself for the next 20 years.

Not likely. Automation only increases productivity and companies are always looking to expand. The only thing automating jobs does it create new ones for people to work.

Re: Meta Unveils New AI Supercomputer

#164

Post by mrkramer »

bduerst wrote: post #154
mrkramer wrote: post #152

Earlier quoted context omitted.

I doubt there will be AGI in our lifetime. Maybe some breakthrough happens but it won't be even close to human intelligence.

I dunno. I didn't think consumer-common machine vision was achievable in our lifetimes either, yet everyone has a phone that can do it. It's like all major tech breakthroughs - it seems impossible despite all the pieces being there, right up until someone puts them together.

Computer vision, image recognition, audio recognition, speech recognition were somewhat easy when Moore's law kicked in and when computer software industry emerged. But AGI is whole another beast. For general intelligence you need to have underlying infrastructure that runs it and guides it just like nervous system does for us people or like operating system does for computers. You can not for example glue together computer vision and speech recognition and call it intelligence when all it does is recognize what it sees and what it hears.

Re: Meta Unveils New AI Supercomputer

#166

Post by cm2012 »

giantrobot wrote: post #148
cm2012 wrote: post #35

Earlier quoted context omitted.

Zuck has vision, especially for what people will want to use. I am looking forward to what FB comes up with here.

Do you get paid in MetaBucks or a real currency? What are the hours and benefits like? Does Zuck wave out a window at you in lieu of cash bonuses?

I get that it's a very unpopular opinion on HN. A bit of why I post comments like these is to have at least one counterpoint in HN threads that are generally anti Facebook. I am genuinely bullish on the prospects of Facebook as a company based on everything I've seen.

Re: Meta Unveils New AI Supercomputer

#167

Post by alex_sf »

vl wrote: post #94
karmasimida wrote: post #43

> Meta’s AI supercomputer houses 6,080 Nvidia graphics-processing units ..... By mid-summer, when the AI Research SuperCluster is fully built, it will house some 16,000 GPUs Honestly ... this is lot of GPUs ... but is it the biggest...? > Model training is done with mixed precision on the NVIDIA DGX SuperPOD-based Selene supercomputer powered by 560 DGX A100 servers networked with HDR InfiniBand in a full fat tree co…

Honestly, this single GPU-based install is child's play compared to Google's multiple TPU exoflop supercomputers with hyper-cube optical interconnects. Google's ML setups allow synchronous weight update on thousand+ TPUs...

Tbh I thought I was being trolled with 'hyper-cube optical interconnects'.

Re: Meta Unveils New AI Supercomputer

#168

Post by strikelaserclaw »

reggieband wrote: post #118

I hate that I always end up referencing the Lex Friedman podcast but it is often relevant to discussion on HN. Recently Lex spoke with Yann LeCun and they had a brief chat about AI at Meta/Facebook [1] (where I believe Yann is currently Chief AI Scientist). He claims that AI is the core of Meta and that if you were to take ML out of Meta systems the company would literally crumble because it is completely built aroun…

I mean what else could he have said? People rarely speak the complete truth if their reputation of paycheck is on the line.

Re: Meta Unveils New AI Supercomputer

#169

Post by mwcampbell »

hooande wrote: post #113
ctoth wrote: post #11

Anybody else get the sense that we're just totally frickin doomed? Even if Yudkowsky is off about AGI (which is a big maybe!) in what possible world will this technology be used to make our individual lives better (assuming you're not a FAIR researcher?)

In theory, this could be used to create AI agents that can process visual/audio information in a way that's more similar to humans. It could lead to household robots or advanced conversational interfaces. or whatever the hell the metaverse is. It's just bunch of GPUs. It could be used for anything people can imagine, good or bad

> create AI agents that can process visual/audio information in a way that's more similar to humans

Which, of course, is great for accessibility.

Re: Meta Unveils New AI Supercomputer

#170

Post by jcims »

reggieband wrote: post #118

I hate that I always end up referencing the Lex Friedman podcast but it is often relevant to discussion on HN. Recently Lex spoke with Yann LeCun and they had a brief chat about AI at Meta/Facebook [1] (where I believe Yann is currently Chief AI Scientist). He claims that AI is the core of Meta and that if you were to take ML out of Meta systems the company would literally crumble because it is completely built aroun…

>I hate that I always end up referencing the Lex Friedman podcast but it is often relevant to discussion on HN.

I do the same thing and feel the same way, like I'm astroturfing or something. If its any consolation, I don't remember ever seeing your references and I hope you don't remember mine.

Post reply on HN