Micron Kicks Off Production of HBM3E Memory
anandtech.com
Micron Kicks Off Production of HBM3E Memory
1–10 of 39 posts
Re: Micron Kicks Off Production of HBM3E Memory
#2How about higher capacity GDDR6X?
48GB consumer cards (or 96GB pro cards) would sell like hotcakes if AMD/Intel dare to break the artificial VRAM segmentation status quo.
Re: Micron Kicks Off Production of HBM3E Memory
#3How about higher capacity GDDR6X? 48GB consumer cards (or 96GB pro cards) would sell like hotcakes if AMD/Intel dare to break the artificial VRAM segmentation status quo.
Build it and people will start porting their CUDA stuff to run on other architectures.
Re: Micron Kicks Off Production of HBM3E Memory
#4And Samsung just launched 36 GB packages of HBM3E: https://www.anandtech.com/show/21278/samsung-launches-12hi-3...
Combined with this[1] interesting paper from summer 2023 on HBM combined with Xeon processors which would now allow for 144 GB on a single CPU. In theory at least.
1: https://lenovopress.lenovo.com/lp1738-implementing-intel-hig...
Re: Micron Kicks Off Production of HBM3E Memory
#5How about higher capacity GDDR6X? 48GB consumer cards (or 96GB pro cards) would sell like hotcakes if AMD/Intel dare to break the artificial VRAM segmentation status quo.
You over estimate the 'semi-pro' market for graphics cards. Gamers are barely willing to pay for 20GB. There's no market for consumer cards with an order of magnitude more RAM until games are built to use that memory.
Re: Micron Kicks Off Production of HBM3E Memory
#6How about higher capacity GDDR6X? 48GB consumer cards (or 96GB pro cards) would sell like hotcakes if AMD/Intel dare to break the artificial VRAM segmentation status quo.
You over estimate the 'semi-pro' market for graphics cards. Gamers are barely willing to pay for 20GB. There's no market for consumer cards with an order of magnitude more RAM until games are built to use that memory.
48GB cards would sell like hotcakes. The problem is that they would sell way less cards aimed at professionals, where they have much higher margins.
Re: Micron Kicks Off Production of HBM3E Memory
#7How about higher capacity GDDR6X? 48GB consumer cards (or 96GB pro cards) would sell like hotcakes if AMD/Intel dare to break the artificial VRAM segmentation status quo.
You over estimate the 'semi-pro' market for graphics cards. Gamers are barely willing to pay for 20GB. There's no market for consumer cards with an order of magnitude more RAM until games are built to use that memory.
This is for ML, not gamers. There is an entirely different market here.
Re: Micron Kicks Off Production of HBM3E Memory
#8And Samsung just launched 36 GB packages of HBM3E: https://www.anandtech.com/show/21278/samsung-launches-12hi-3... Combined with this[1] interesting paper from summer 2023 on HBM combined with Xeon processors which would now allow for 144 GB on a single CPU. In theory at least. 1: https://lenovopress.lenovo.com/lp1738-implementing-intel-hig...
> launched
Not true. They announced completion of development, with intention to begin mass production in H1. So a couple months out, at least.
> Micron's memory roadmap for AI is further solidified with the upcoming release of a 36 GB 12-Hi HBM3E product in March 2024.
So likely competitive timing with Samsung for 36/12.
Re: Micron Kicks Off Production of HBM3E Memory
#9Earlier quoted context omitted.
You over estimate the 'semi-pro' market for graphics cards. Gamers are barely willing to pay for 20GB. There's no market for consumer cards with an order of magnitude more RAM until games are built to use that memory.
48GB cards would sell like hotcakes. The problem is that they would sell way less cards aimed at professionals, where they have much higher margins.
Intel doesn't sell a lot of graphics cards whatsoever though. Be the first to offer 64GB of VRAM for under $1000 and that could change pretty fast.
Re: Micron Kicks Off Production of HBM3E Memory
#10How about higher capacity GDDR6X? 48GB consumer cards (or 96GB pro cards) would sell like hotcakes if AMD/Intel dare to break the artificial VRAM segmentation status quo.
I swear I'm getting Deja Vu right now, I coulda sworn I've seen this thread before. There's gonna be a guy commenting that "you don't need it" somebody else saying "but I want it!" And a few trying to figure out the economics of it and whether or not it makes any sense.
Personally I'd love to have as much VRAM as possible (and as high a bandwidth as is possible too) to mess around with simulations in- but that's definitely a pro workload.
I'd love to see like a flagship card have a stupid amounts of VRAM spec option - like an RTX 4090 with 32-48gb of VRAM just to see what happens with it on the market.