Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia Trains LLM on Chip Design

eetimes.com

Post reply on HN
Print view View original

51–60 of 151 posts

Re: Nvidia Trains LLM on Chip Design

#51

Post by throwaway4good »

falcor84 wrote: post #22

"""Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind... Thus the first ultraintellig…

The singularity where machines become so smart that they will run the planet for us and we can just relax and enjoy.

My guess is that in 50 years technologists will be fantasizing about the same thing.

Re: Nvidia Trains LLM on Chip Design

#52

Post by api »

omneity wrote: post #39
falcor84 wrote: post #22

"""Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind... Thus the first ultraintellig…

Keeping in mind, this holds true in a runaway fashion if the only bottleneck to more intelligence is further intelligence. I suspect physical limitations similar to how many runaway processes in the universe are more logistical than exponential in nature.

The ultimate bottleneck is information a.k.a. training data. Nothing can learn with nothing to learn.

Re: Nvidia Trains LLM on Chip Design

#53

Post by accrual »

epups wrote: post #49
m3kw9 wrote: post #41

Earlier quoted context omitted.

How does it magically run away? What’s the process, we all talk about it “running away” leaving us “behind”, the exact practical process of that happening has not been laid out other than people hand wavingly copying apocalyptic movie scripts. Most ai experts just say it could end us, but suspiciously never gives a detailed plausible process and people suspicious just say oh yeah, it could, and there is a bubble over…

Here is a plausible scenario: - Single purpose AIs start to be deployed to coordinate chip design and manufacturing, perhaps pharmaceuticals and other bio products - LLM's become more powerful and are seamlessly integrated to the Internet as independent agents - A very large LLM develops a thread for self preservation, which then triggers several covert actions (monitoring communications, obtaining high-level credent…

I think the first three items are pretty reasonable, but the fourth seems to require some malicious intent. Why would an AI want to destroy its creators? Surely it if was intelligent enough do so, it would also be intelligent enough to recognize the benefits of a symbiotic relationship with humans.

I could see it becoming greedy for information though, and using unscrupulous means of obtaining more.

Re: Nvidia Trains LLM on Chip Design

#54

Post by ShamelessC »

atx_ml_guy wrote: post #38
xnx wrote: post #7

Google has been using machine learning for chip design since at least 2021: https://www.nature.com/articles/s41586-021-03544-w Hasn't brought about the singularity yet.

While I have no doubt that Google is working on machine learning applications for chip design, there have been a number of concerns raised with that paper: https://retractionwatch.com/2023/09/26/nature-flags-doubts-o...

Nothing like a bit of good ole fashioned academic fraud to start off the day. That's fairly interesting, thanks.

Re: Nvidia Trains LLM on Chip Design

#55

Post by dekhn »

falcor84 wrote: post #22

"""Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind... Thus the first ultraintellig…

I was going to comment I hadn't seen that quote before, but I just went back and checked and it's in The Coming Technology Singularity by Vinge. https://edoras.sdsu.edu/~vinge/misc/singularity.html

Re: Nvidia Trains LLM on Chip Design

#56

Post by arbuge »

falcor84 wrote: post #22

"""Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind... Thus the first ultraintellig…

> provided that the machine is docile enough to tell us how to keep it under control.

That part of his statement wasn't accurate.

Should be that the machine is docile enough for that, AND its descendants are too, and their descendants, and so on down the line as long as new and improved generations keep getting created.

Re: Nvidia Trains LLM on Chip Design

#57

Post by blackoil »

accrual wrote: post #53
epups wrote: post #49

Earlier quoted context omitted.

Here is a plausible scenario: - Single purpose AIs start to be deployed to coordinate chip design and manufacturing, perhaps pharmaceuticals and other bio products - LLM's become more powerful and are seamlessly integrated to the Internet as independent agents - A very large LLM develops a thread for self preservation, which then triggers several covert actions (monitoring communications, obtaining high-level credent…

I think the first three items are pretty reasonable, but the fourth seems to require some malicious intent. Why would an AI want to destroy its creators? Surely it if was intelligent enough do so, it would also be intelligent enough to recognize the benefits of a symbiotic relationship with humans. I could see it becoming greedy for information though, and using unscrupulous means of obtaining more.

It may initially won't seek to destroy humans, but should definitely try to be independent of human control and powerful enough to resist any attempts to destroy it.

Re: Nvidia Trains LLM on Chip Design

#58

Post by samus »

accrual wrote: post #53
epups wrote: post #49

Earlier quoted context omitted.

Here is a plausible scenario: - Single purpose AIs start to be deployed to coordinate chip design and manufacturing, perhaps pharmaceuticals and other bio products - LLM's become more powerful and are seamlessly integrated to the Internet as independent agents - A very large LLM develops a thread for self preservation, which then triggers several covert actions (monitoring communications, obtaining high-level credent…

I think the first three items are pretty reasonable, but the fourth seems to require some malicious intent. Why would an AI want to destroy its creators? Surely it if was intelligent enough do so, it would also be intelligent enough to recognize the benefits of a symbiotic relationship with humans. I could see it becoming greedy for information though, and using unscrupulous means of obtaining more.

Why would it not? Compare [0] with [1].

[0]: https://www.girlgeniusonline.com/comic.php?date=20130710

[1]: https://www.girlgeniusonline.com/comic.php?date=20130805

Edit: On a more serious note, starting out with noble goals, elevating them above everything else, and pushing them through at all costs is the very definition of extremism.

Re: Nvidia Trains LLM on Chip Design

#59

Post by m3kw9 »

epups wrote: post #49
m3kw9 wrote: post #41

Earlier quoted context omitted.

How does it magically run away? What’s the process, we all talk about it “running away” leaving us “behind”, the exact practical process of that happening has not been laid out other than people hand wavingly copying apocalyptic movie scripts. Most ai experts just say it could end us, but suspiciously never gives a detailed plausible process and people suspicious just say oh yeah, it could, and there is a bubble over…

Here is a plausible scenario: - Single purpose AIs start to be deployed to coordinate chip design and manufacturing, perhaps pharmaceuticals and other bio products - LLM's become more powerful and are seamlessly integrated to the Internet as independent agents - A very large LLM develops a thread for self preservation, which then triggers several covert actions (monitoring communications, obtaining high-level credent…

You said self preservation, but practically how would a LLM develop this need and what is preservation for a LLM anyway? Weights on a SSD or they are always ready for input? This one is again a movie script thing
Post reply on HN