Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Memory has grown to nearly two-thirds of AI chip component costs

epoch.ai

Post reply on HN
Print view View original

401–410 of 524 posts

Re: Memory has grown to nearly two-thirds of AI chip component costs

#401

Post by Hamuko »

raincole wrote: post #341
brandensilva wrote: post #183

Earlier quoted context omitted.

China is about to flood the market and prove this notion wrong. If there is demand they want to meet it with supply. But to your point, that is exactly how American companies like to play now. No one is stopping them from screwing over the consumer. I have a Micron near me and they are building another chip facility but we are years away still so I suspect China will beat them to the punch.

Not just DRAM market, but the GPU market soon. China is the great equalizer of the world.

Not really sure if I'd describe what China has done to various manufacturing sectors as "equalizing".

Re: Memory has grown to nearly two-thirds of AI chip component costs

#402

Post by scheme271 »

magicalhippo wrote: post #384
amluto wrote: post #292

Earlier quoted context omitted.

As far as I can tell, Micron and SK Hynix are using EUV lithography and may be constrained by availability of the equipment, whereas CXMT does not have EUV machines. There were reports that EUV lithography is needed for high yields, but CXMT appears to be proving that wrong.

Micron was dragging its heel on EUV and only got it last year[1]. Seems it's mostly useful for LPDDR modules which are predominantly used in battery-powered devices and to improve margins. [1]: https://www.tomshardware.com/pc-components/dram/micron-sampl...

LPDDR is used by the Nvidia rubin platform. I can see AMD using lpddr as well because it gives you denser memory at the same or reduced power budgets.

Re: Memory has grown to nearly two-thirds of AI chip component costs

#403

Post by Ekaros »

esseph wrote: post #257
ahartmetz wrote: post #231

Earlier quoted context omitted.

It is not a law of nature that Chinese products are lower quality (cf. electric cars) and I don't see why they would go for that. They can just bin what they produce like everyone else and sell their products for what they have been tested to deliver.

This has nothing to do about nationality, it has everything to do with building and running a brand new, highly technical, mass production facility.

The west absolutely loves enshitified products. So why not sell them what they want? If they wanted quality they would pay slightly more and do something about it.

Re: Memory has grown to nearly two-thirds of AI chip component costs

#404

Post by sznio »

downrightmike wrote: post #325
XorNot wrote: post #247

Earlier quoted context omitted.

China wants a sovereign DRAM capacity. They're playing an entirely different game then the commercial suppliers in the West.

And those commercial suppliers are making it too easy an putting themselves out of business before 2030

all that matters is next quarter.

Re: Memory has grown to nearly two-thirds of AI chip component costs

#405

Post by Ekaros »

epolanski wrote: post #285
jmalicki wrote: post #168

Earlier quoted context omitted.

For lifespan, AWS is still running a ton of T4 GPUs from 2018, that power a lot of computer vision models. A ton of these will have a long life, not all ML is about frontier LLMs.

How can it be economically viable to still run them? You can get 100x the output with the same energy use.

As long as you have customers that are willing to pay more than it cost you are fine. And with AWS seemingly there is plenty of those. So question isn't is this most efficient way but will someone pay at price that is above what new hardware could attain.

Re: Memory has grown to nearly two-thirds of AI chip component costs

#408

Post by rldjbpin »

I_am_tiberius wrote: post #98

It seems to me the max memory you can buy in a laptop stagnated for the past 3 years or so.

for the most part, unless soldered down, it has been hard to find higher than dual channel (maybe quad for a massive odm gaming laptop). each stick and platform having set maximum memory capacity has put a glass ceiling for those machines.

doesn't matter anyway when things are not reasonably priced. i am stuck at the same memory capacity in my personal system for the better part of two decades, partially due to the above and the current pricing today.

Re: Memory has grown to nearly two-thirds of AI chip component costs

#410

Post by henriquez »

bitmasher9 wrote: post #365
gpm wrote: post #352

Earlier quoted context omitted.

> Not just DRAM market, but the GPU market soon China doesn't have EUV fabs... They've pushed DUV impressively far... but until they get EUV working industrially (and reasonable timelines are at least 2-4 years for that) it shouldn't be possible for them to compete for that market. > China is the great equalizer of the world. China is hardly an egalitarian society...

The future is here now, it’s just not evenly distributed. China will mass produce something to the point that it is widely distributed. That is how China acts as a great equalizer on a global scale. Another way China is a great equalizer is their willingness to do business with anyone that can pay.

[dead]
Post reply on HN