Earlier quoted context omitted.
Going off of how the 4090 and 7900 xtx is arranged I think you could maybe fit on or two chips more around the die over their 12, but that's still a far cry from 128. That would probably just need a shared bus like normal DDR as you're not fitting that much with 16 gbit density
What if we did what others suggested was the practical limit - 48GB. Then just put 2-3 cards in the system and maybe had a little bridge over a separate bus for them to communicate?
Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
271–280 of 722 posts
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#272Earlier quoted context omitted.
AMD has a 192GB GPU. I don’t see them eating NVidia’s lunch with it.
They are charging as much as Nvidia for it. Now imagine they offered such a card for $2k. Would that allow them to eat Nvidia's lunch?
Models are getting larger, not smaller. This is why H200 has more memory, but the same exact compute. MI300x vs. MI325x... more memory, same compute.
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#273Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#274Earlier quoted context omitted.
M3/M4 Max MacBooks with 128GB RAM are already way better than an A6000 for very large local LLMs. So even if the GPU is as slow as the one in M3/M4 Max (<3070), and using some basic RAM like LPDDR5x it would still be way faster than anything from NVidia.
The M4 Max needs an enormous 512bit memory bus to extract enough bandwidth out of those LPDDR5x chips, while the GPUs that Intel just launched are 192/160bit and even flagships rarely exceed 384bit. They can't just slap more memory on the board, they would need to dedicate significantly more silicon area to memory IO and drive up the cost of the part, assuming their architecture would even scale that wide without hit…
Sure that was only gddr5 and not gddr6 or lpddr5, but I would have bet we'd be up to 512bit again 10 years down the line..
(I mean supposedly hbm3 has done 1024-2048bit busses but that seems more research or super high end cards, not consumer)
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#275Earlier quoted context omitted.
Because Apple isn't playing the same game as everyone else. They have the money and clout to buy out TSMCs bleeding-edge processes and leave everyone else with the scraps, and their silicon is only sold in machines with extremely fat margins that can easily absorb the BOM cost of making huge chips on the most expensive processes money can buy.
Bleeding edge processes is what Intel specializes in. Unlike Apple, they don’t need TSMC. This should have been a huge advantage for Intel. Maybe that’s why Gelsinger got the boot.
Intel literally outsourced their Arrow Lake manufacturing to TSMC because they couldn't fabricate the parts themselves - their 20A (2nm) process node never reached a production-ready state, and was eventually cancelled about a month ago.
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#276Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#277Earlier quoted context omitted.
I think there'll be a "financial" winter - or another way a bubble burst - the investment right now is simply unsustainable, how are these products going to be monetized? Nvidia had a revenue of $27billion in 2023 - that's about $160 per person per year [0] for every working age person in the USA. And it's predicted to more than double in 2024. If you reduce that to office workers (you know, the people who might actu…
I think the more accurate denominator would be the world population. People are seeing benefits to LLMs even outside of the office.
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#278Earlier quoted context omitted.
I think there'll be a "financial" winter - or another way a bubble burst - the investment right now is simply unsustainable, how are these products going to be monetized? Nvidia had a revenue of $27billion in 2023 - that's about $160 per person per year [0] for every working age person in the USA. And it's predicted to more than double in 2024. If you reduce that to office workers (you know, the people who might actu…
I think the more accurate denominator would be the world population. People are seeing benefits to LLMs even outside of the office.
For example ?
(besides deep fakes)
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#279Earlier quoted context omitted.
NVidia and AMD make $$$ on datacenter GPUs so it makes sense they don't want to discount their own high-end. Intel has nothing there so they can happily go for commodization of AI hardware like what Meta did when releasing LLaMA to the wild.
Is nVidia or AmD offering 128gb cards in any configuration?
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#280Earlier quoted context omitted.
They all look like amusement parks nowadays.
You can get a clean Fractal Design case with 0 lights or RGB. You are showing your ignorance. :) Also, RGB means RGB... just set the color to white for a more clean look? But reading the manual is not for you.