Live data from Hacker News

Ask HN: Is Moore's Law over, or not?

news.ycombinator.com

41–50 of 94 posts

Re: Ask HN: Is Moore's Law over, or not?

#41
post #4

Nvidia thinks that Moore's Law is dead. https://arstechnica.com/gaming/2022/09/do-expensive-nvidia-g... Intel, by contrast, says that Moore's Law is still alive. But Intel is technologically behind, and it is easier to improve when there is someone to learn from, so maybe there is a wall that they haven't yet hit. Regardless, it is a very different law than when I was young, when code just magically got faster each y…

> Intel is technologically behind, and it is easier to improve when there is someone to learn from

This is interesting to me, how did they end up like this?

Re: Ask HN: Is Moore's Law over, or not?

#42
post #4

Nvidia thinks that Moore's Law is dead. https://arstechnica.com/gaming/2022/09/do-expensive-nvidia-g... Intel, by contrast, says that Moore's Law is still alive. But Intel is technologically behind, and it is easier to improve when there is someone to learn from, so maybe there is a wall that they haven't yet hit. Regardless, it is a very different law than when I was young, when code just magically got faster each y…

Nvidia and Intel are in very different markets and their product ranges barely overlap.

And well Nvidia is almost a monopoly at this point so they have barely any incentives to continue innovating as opposed trying to extract as much money as possible from their clients.

On the other hand look at what happened with CPUs over the last few years. Huge improvements in efficiency (including Intel)

> hasn't really improved in the last 15 years.

I don’t think that’s even close to being the case in almost all use cases. Increasing complexity/bloat has obfuscated that to a large degree though.

Re: Ask HN: Is Moore's Law over, or not?

#44
post #4

Nvidia thinks that Moore's Law is dead. https://arstechnica.com/gaming/2022/09/do-expensive-nvidia-g... Intel, by contrast, says that Moore's Law is still alive. But Intel is technologically behind, and it is easier to improve when there is someone to learn from, so maybe there is a wall that they haven't yet hit. Regardless, it is a very different law than when I was young, when code just magically got faster each y…

> Intel is technologically behind, and it is easier to improve when there is someone to learn from This is interesting to me, how did they end up like this?

By being so much ahead of everyone else that they thought that didn’t have to do anything anymore.

On desktop, anyway. Mobile is a different store, back in the mid 2000s they had everything to dominate the market for the next 10+ years (e.g. the fastest ARM chips) yet choose not to due to reasons..

Re: Ask HN: Is Moore's Law over, or not?

#45
post #27

Earlier today on HN there was a submission about great CPU stagnation. In the blog post was an interesting link: https://raw.githubusercontent.com/karlrupp/microprocessor-tr... This graph to me show that while yes technically Moore's law of doubling transistor per "thing Intel or AMD sells you" is still holding, it has ended for single threaded workloads. Moore's law is only holding due to core count increase. For ev…

>Writing amazing programs taking full advantage of the core count increase is simply impossible (see Amdahl's law).

Do you need theoretical full?

Practical full is enough and still huge improvement over single core

Re: Ask HN: Is Moore's Law over, or not?

#46
Moore's law is still going strong. But when people talk about Moore's Law ending they normally mean a wider set of trends, specifically:

- Transistor count doubles every ~24 months (Moore's law) - still going strong

- Total power stays ~constant (Dennard Scaling) - no longer holds

- Total cost stays ~constant - don't know if there is a name for this, but it no longer holds either

The real magic was when you had all three trends working together, you would get more transistors for the same power and same total cost. As the last two trends have fallen off, the benefit of Moore's law by itself is reduced.

There is still some effect of the last two trends, power per transistor and cost per transistor are still dropping, just at a slower rate than density is increasing. So power budgets and costs continue to grow. Hence 450W GPUs and 400W CPUs.

Re: Ask HN: Is Moore's Law over, or not?

#47

Earlier quoted context omitted.

Nvidia is trying to reset expectations of consumers. Jensen aims to charge more for more GPU computing power into the future. This is because Nvidia has close to monopoly power this is able to break Moores Law single handedly.

Hell, they are able to sell graphic cards, well not nVidia themselves but still, in excess of 2k bucks. They'd be stupid not to try to keep prices that high, now the market seemlingy accept them.

They might be putting themselves in a similar position as Intel though (maybe worse since I don’t recall Intel ever being as greedy..) if their competitors eventually catch up.

Unlike in gaming in the data center initial cost + performance per watt are the only thing that really matter (besides software, Nvidia has a huge moat there..). And in relation to how much Nvidia is charging per GPU total power costs are close to zero.. So 4 ‘worse’ but much cheaper chips might be a better deal than buying an A/H100 etc.

Re: Ask HN: Is Moore's Law over, or not?

#48
post #4

Nvidia thinks that Moore's Law is dead. https://arstechnica.com/gaming/2022/09/do-expensive-nvidia-g... Intel, by contrast, says that Moore's Law is still alive. But Intel is technologically behind, and it is easier to improve when there is someone to learn from, so maybe there is a wall that they haven't yet hit. Regardless, it is a very different law than when I was young, when code just magically got faster each y…

Nvidia is trying to reset expectations of consumers. Jensen aims to charge more for more GPU computing power into the future. This is because Nvidia has close to monopoly power this is able to break Moores Law single handedly.

interesting take

otoh it can be said that gpu's just look like they improved longer than cpu's because their workload is vastly more susceptible to parallelism.

Re: Ask HN: Is Moore's Law over, or not?

#49
post #31

Earlier quoted context omitted.

Yeah, after listening to Keller speak about it on Lex's podcast, I'm convinced he probably knows more than about anybody. Another vote for not dead.

Why do you feel the need to appeal to authority here? Moore's law states that the number of transistors on a chip doubles every two years. Looking at the data[0] confirms, yes, Moore's law is still alive. [0]: https://upload.wikimedia.org/wikipedia/commons/0/00/Moore%27...

It's true that Moore's original claim was about number of transistors and not about any actual metric of performance.

But "number of transistors" is like "number of lines of code": it's a cost, not a benefit, and if it feels otherwise it's only because that cost is the cost we have to pay for some benefit we care about.

And the claim that's increasingly commonly made these days isn't "transistor density has stopped improving" (though I think that's slowed down somewhat since Moore's time?) but more like "performance has stopped improving".

If we are putting more and more transistors on our chips (hence, larger die area, lower yields, more cost, more heat produced, more expensive cooling required) but not getting corresponding performance improvements in the tasks we actually value, then the thing everyone actually valued about Moore's law is dead, regardless of the status of the literal words of Moore's claim.

Re: Ask HN: Is Moore's Law over, or not?

#50
I think it's worth mentioning, that "Moore's Law" is not actually a "law". It's just an observation of a historical trend.

Moore posited in 1965 that the the amount of transistor per chip will roughly double every year - something he himself called "a wild extrapolation" in a later interview.

Actual development speed proved slower than that, so in 1975 he revised his prediction to transistors doubling every two years - so, the original "Moore's Law" was already dead by then. The second revision of his prediction proved more long-lived, in part because manufacturers were actively planning their development and releases around fulfilling that expectation - making it sorta a self-fulfilling prophecy.

There was another slow down in 2010 though - with actual development falling behind "schedule" since then.

But neither the "doubling" - nor the "year" or "two years" were ever anywhere near precise to begin with, so the question "is it dead" depends highly on how much leeway you are willing to give.

If you demand strict doubling every year - that's been dead since before 1975.

If you demand roughly doubling every two years - that's probably mostly dead since 2010.

If you allow for basically exponential growth but with a tiny bit of slow down over time - then it's still alive and well.

There can be no precise answer to the question - since the whole prediction was so imprecise to begin with. I don't think there's any benefit to getting hung up on drawing a supposedly precise line in the sand...

Post reply on HN