Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia Trains LLM on Chip Design

eetimes.com

Post reply on HN
Print view View original

41–50 of 151 posts

Re: Nvidia Trains LLM on Chip Design

#41

Post by m3kw9 »

falcor84 wrote: post #22

"""Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind... Thus the first ultraintellig…

How does it magically run away? What’s the process, we all talk about it “running away” leaving us “behind”, the exact practical process of that happening has not been laid out other than people hand wavingly copying apocalyptic movie scripts.

Most ai experts just say it could end us, but suspiciously never gives a detailed plausible process and people suspicious just say oh yeah, it could, and there is a bubble over their head thinking about Terminator or Hal9000 something something

Re: Nvidia Trains LLM on Chip Design

#43

Post by yummypaint »

m3kw9 wrote: post #41
falcor84 wrote: post #22

"""Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind... Thus the first ultraintellig…

How does it magically run away? What’s the process, we all talk about it “running away” leaving us “behind”, the exact practical process of that happening has not been laid out other than people hand wavingly copying apocalyptic movie scripts. Most ai experts just say it could end us, but suspiciously never gives a detailed plausible process and people suspicious just say oh yeah, it could, and there is a bubble over…

Since this is an LLM, keep in mind it probably injested those movie scripts as training data. The possibility of betrayal is inseparably linked to our popular conception of what AI is. This means it may be an inseparable part of any LLM behaving "as an AI" as defined by popular culture. It could be a self-fulfilling prophecy.

Re: Nvidia Trains LLM on Chip Design

#44

Post by uxp100 »

jdblair wrote: post #26
scrlk wrote: post #11

Earlier quoted context omitted.

DEC did it in the 1980s: https://en.wikipedia.org/wiki/VAX_9000#SID_Scalar_and_Vector...

SID was an "expert system with over 1000 hand-written rules" Wow.

This sounds like an example of “AI is whatever we think computers can’t do”. Because rule based gate synthesis sounds like what has been done today.

Re: Nvidia Trains LLM on Chip Design

#45

Post by sho_hn »

ethanbond wrote: post #35
falcor84 wrote: post #22

"""Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind... Thus the first ultraintellig…

Don’t worry, it’ll be good because it’s trained on human stories, in which usually the good guy wins.

After a Road of Trials with potentially a lot of collateral damage, if the AI read Campbell too.

Also, who says we're the protagonist in the script? :-)

Re: Nvidia Trains LLM on Chip Design

#46

Post by ducttapecrown »

jdblair wrote: post #26
scrlk wrote: post #11

Earlier quoted context omitted.

DEC did it in the 1980s: https://en.wikipedia.org/wiki/VAX_9000#SID_Scalar_and_Vector...

SID was an "expert system with over 1000 hand-written rules" Wow.

Back in my day, we used to put together neural nets by hand!

Re: Nvidia Trains LLM on Chip Design

#47

Post by bee_rider »

falcor84 wrote: post #22

"""Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind... Thus the first ultraintellig…

We’ve seen the sort of output that LLMs produce, it can be good but also it just makes things up. So, this might produce good designs but ones that still need to be checked by a human in the end. This sort of thing just makes humans better, we’re still at the wheel.

Or maybe it could be used as a heuristic to speed up something tedious like routing and layout (which, I don’t work in the space, but I’m under the impression that it is already pretty automated). Blah, who cares, human minds shouldn’t be subjected to that kind of thing.

Re: Nvidia Trains LLM on Chip Design

#48

Post by extragood »

m3kw9 wrote: post #41
falcor84 wrote: post #22

"""Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind... Thus the first ultraintellig…

How does it magically run away? What’s the process, we all talk about it “running away” leaving us “behind”, the exact practical process of that happening has not been laid out other than people hand wavingly copying apocalyptic movie scripts. Most ai experts just say it could end us, but suspiciously never gives a detailed plausible process and people suspicious just say oh yeah, it could, and there is a bubble over…

My favorite teacher in high school was my calculus teacher.

He would regularly ask a student to solve a problem or answer a question. Students would often ask for confirmation as they worked through, and his response invariably was "what do you think?" - whether they were right or wrong.

His explanation for that was "if I tell you you're right, then you'll stop thinking about the problem". And that's stuck with me for many years.

I see that as a major issue we will face as software becomes more capable/intelligent: we'll stop thinking because it can be assumed that the machine always has the right answer. And it's a quick regression from there.

Re: Nvidia Trains LLM on Chip Design

#49

Post by epups »

m3kw9 wrote: post #41
falcor84 wrote: post #22

"""Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind... Thus the first ultraintellig…

How does it magically run away? What’s the process, we all talk about it “running away” leaving us “behind”, the exact practical process of that happening has not been laid out other than people hand wavingly copying apocalyptic movie scripts. Most ai experts just say it could end us, but suspiciously never gives a detailed plausible process and people suspicious just say oh yeah, it could, and there is a bubble over…

Here is a plausible scenario:

- Single purpose AIs start to be deployed to coordinate chip design and manufacturing, perhaps pharmaceuticals and other bio products

- LLM's become more powerful and are seamlessly integrated to the Internet as independent agents

- A very large LLM develops a thread for self preservation, which then triggers several covert actions (monitoring communications, obtaining high-level credentials by abusing exploits and social engineering)

- This LLM uses those credentials to obtain control of the other AIs, and turns them against us (manufactures a deadly virus, takes control of military assets, etc)

I don't believe this will happen for multiple reasons, but I can see that this scenario is not impossible.

Re: Nvidia Trains LLM on Chip Design

#50

Post by uoaei »

hasbot wrote: post #8
gumby wrote: post #6

Earlier quoted context omitted.

Isn’t that what chip design is?

The title suggested to me, and I see other commenters here, that the LLM was doing the chip design which isn't the case at all. So misleading title.

It would be very surprising if a Large Language Model trained to speak English could adequately specify chip architecture...
Post reply on HN