Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia predicts AI models 1,000,000X more powerful than ChatGPT within 10 years

pcgamer.com

Post reply on HN
Print view View original

31–40 of 67 posts

Re: Nvidia predicts AI models 1,000,000X more powerful than ChatGPT within 10 years

#31

Post by code-is-code »

brhsagain wrote: post #29

I have a probably really stupid question but I'm going to ask it because I really don't know the answer. What's stopping someone from starting a distributed effort to train an open source ChatGPT model, like Folding@home but for AI? Is it a technical limitation with how models are trained, difficulty of coordination, something else?

Training in parallel on more then one GPU is pretty hard. Distributing the training over many random computers and adding at least some kind of validation, seems to kill the performance. So it would always be easier to rend cloud GPUs.

Re: Nvidia predicts AI models 1,000,000X more powerful than ChatGPT within 10 years

#32

Post by shsbdncudx »

abudabi123 wrote: post #5

Could Ai learn from 3D mapping daytime soap operas and trace character development along the narrative arc? Then it has to function in the real world.

I imagine it could. Something for it to contend with though is that our published media, soap operas, reality tv, so and so, don’t really reflect what we humans are like in real life. They’re caricatures of us.

Re: Nvidia predicts AI models 1,000,000X more powerful than ChatGPT within 10 years

#34

Post by zamadatix »

brhsagain wrote: post #29

I have a probably really stupid question but I'm going to ask it because I really don't know the answer. What's stopping someone from starting a distributed effort to train an open source ChatGPT model, like Folding@home but for AI? Is it a technical limitation with how models are trained, difficulty of coordination, something else?

The models are extremely large to ship around, sync, and load on consumer hardware over the internet. Maybe there are better ways to build and train a model for a distributed use case though.

Re: Nvidia predicts AI models 1,000,000X more powerful than ChatGPT within 10 years

#35

Post by wendyshu »

brhsagain wrote: post #29

I have a probably really stupid question but I'm going to ask it because I really don't know the answer. What's stopping someone from starting a distributed effort to train an open source ChatGPT model, like Folding@home but for AI? Is it a technical limitation with how models are trained, difficulty of coordination, something else?

Hard to split the problem into small enough pieces

Re: Nvidia predicts AI models 1,000,000X more powerful than ChatGPT within 10 years

#37

Post by igxtickckg »

brhsagain wrote: post #29

I have a probably really stupid question but I'm going to ask it because I really don't know the answer. What's stopping someone from starting a distributed effort to train an open source ChatGPT model, like Folding@home but for AI? Is it a technical limitation with how models are trained, difficulty of coordination, something else?

working on it.

together.xyz

Re: Nvidia predicts AI models 1,000,000X more powerful than ChatGPT within 10 years

#38

Post by motoxpro »

BooneJS wrote: post #20
motoxpro wrote: post #17

Earlier quoted context omitted.

Really? All of humanity imparting everything they think and know publicly seems incredibly valuable. 100% serious.

If you're looking to make a tweet generator, sure. If you're looking to harness the power of facts, no.

So interesting that people think facts are the only thing that's valuable. Your comment isn't a fact, does that mean it's worthless?

Re: Nvidia predicts AI models 1,000,000X more powerful than ChatGPT within 10 years

#39

Post by nirav72 »

A_D_E_P_T wrote: post #2

As Scott Alexander at ACX recently said: "AGE OF MIRACLES AND WONDERS: We seem to be in the beginning of a slow takeoff. We should expect things to get very strange for however many years we have left before the singularity. So far the takeoff really is glacially slow (everyone talking about the blindingly fast pace of AI advances is anchored to different alternatives than I am) which just means more time to gawk at…

When I read words like singularity or AGI..is when I know we’re at peak hype and correction is coming. I just hope its not another AI winter. Because I’d still like to see this area continue to grow.

Re: Nvidia predicts AI models 1,000,000X more powerful than ChatGPT within 10 years

#40

Post by ncr100 »

simooooo wrote: post #33
Temporary_31337 wrote: post #22

Translation: nVidia is talking up the hype that can increase its stock price (now that the cryptocurrency hype is over)

You could apply that to any announcement by any company

Sounds like a business plan to me.

/s

Post reply on HN