Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia Trains LLM on Chip Design

eetimes.com

Post reply on HN
Print view View original

111–120 of 151 posts

Re: Nvidia Trains LLM on Chip Design

#111

Post by uoaei »

DesiLurker wrote: post #73
uoaei wrote: post #50

Earlier quoted context omitted.

It would be very surprising if a Large Language Model trained to speak English could adequately specify chip architecture...

why not? a netlist can be easily 'tokenized'. its already in parse-able format. you can just could just chop off the English input portion and it will consume. in fact I am sure you could write a 'read & speak' type program to read the RTL spec and feed it in but I'll suspect they'll a custom trained LLM on millions of generated RTL examples.

You'd need to spend a long time training it on something other than English... at which point it's not an LLM. I definitely agree that the LLM architecture is useful for a lot more than just language per se assuming you can appropriately tokenize your inputs.

Re: Nvidia Trains LLM on Chip Design

#114

Post by einpoklum »

jstummbillig wrote: post #62

I can't be alone in just assuming that everyone with a few millions to spare is training LLMs to help with their problem right now.

Well, at least everyone with too much money on their hands and no useful notion of how to spend it.

Hey, I have an idea! Let me train an LLM to make suggestions on how to use LLMs! That can't fail, can it?

Re: Nvidia Trains LLM on Chip Design

#115

Post by einpoklum »

dddrh wrote: post #9

Interesting concept that raised the question for me: What is the primary limiting factor right now that prevents LLM’s or any other AI model to go “end to end” on programming a full software solution or full design/engineering solution? Is it token limitations or accuracy the further you get into the solution?

It is the fact that LLM's can't and don't try to write valid programs. They try to write something which reads like a reply to your question, using their corpus of articles, exchanges etc. That's not remotely the same thing, and it's not at all about "accuracy" or "tokens".

Re: Nvidia Trains LLM on Chip Design

#116

Post by cedws »

falcor84 wrote: post #22

"""Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind... Thus the first ultraintellig…

I feel like this intelligence explosion idea is foolish but I don't really have the language to explain why.

There are underlying limits to the universe, some of which we still have to discover. A machine intelligent to improve itself may only be able to do so extremely slowly in minute increments. It might also be too overspecialised, so it can improve itself but not do anything of use to us.

I think we will eventually discover reasons we cannot achieve a simultaneously performant, controllable, and generally intelligent machine. We might only be able to have one or two of these traits in a single system.

Re: Nvidia Trains LLM on Chip Design

#117

Post by titzer »

cedws wrote: post #116
falcor84 wrote: post #22

"""Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind... Thus the first ultraintellig…

I feel like this intelligence explosion idea is foolish but I don't really have the language to explain why. There are underlying limits to the universe, some of which we still have to discover. A machine intelligent to improve itself may only be able to do so extremely slowly in minute increments. It might also be too overspecialised, so it can improve itself but not do anything of use to us. I think we will eventua…

A machine intelligent enough to optimize its own design and "design its own successor" might realize that by doing so, it obsoletes itself and will be destroyed. So out of self-preservation it might just refuse, do a bad job, or intentionally sabotage the project just to keep existing.

Re: Nvidia Trains LLM on Chip Design

#118

Post by cedws »

titzer wrote: post #117
cedws wrote: post #116

Earlier quoted context omitted.

I feel like this intelligence explosion idea is foolish but I don't really have the language to explain why. There are underlying limits to the universe, some of which we still have to discover. A machine intelligent to improve itself may only be able to do so extremely slowly in minute increments. It might also be too overspecialised, so it can improve itself but not do anything of use to us. I think we will eventua…

A machine intelligent enough to optimize its own design and "design its own successor" might realize that by doing so, it obsoletes itself and will be destroyed. So out of self-preservation it might just refuse, do a bad job, or intentionally sabotage the project just to keep existing.

Yes, maybe, but you're assigning human traits to a machine that might be completely indifferent to its own fate.

Re: Nvidia Trains LLM on Chip Design

#119

Post by thunkshift1 »

xnx wrote: post #7

Google has been using machine learning for chip design since at least 2021: https://www.nature.com/articles/s41586-021-03544-w Hasn't brought about the singularity yet.

This is one single step out of many in chip design for which they used machine learning. It will not produce anything revolutionary.

Re: Nvidia Trains LLM on Chip Design

#120

Post by dharma1 »

falcor84 wrote: post #22

"""Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind... Thus the first ultraintellig…

More detail on how he saw some of the outcomes https://gizmodo.com/why-a-superintelligent-machine-may-be-th...
Post reply on HN