Earlier quoted context omitted.
because then instead of RAM bandwidth now you're dealing with PCIe BW which is way less.
Also less power efficient, takes up more PCI slots and a lot of software doesn't support GPU clustering. Already have 4x 16GB GPUs which is unable to run large models exceeding 16GB. Currently running them different VMs to be able to make full use of them, used to have them running in different docker containers however OOM Exceptions would frequently bring down the whole server, which running in VMs helped resolve.
Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations
241–250 of 274 posts
Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations
#242Earlier quoted context omitted.
they don't manufacture RAM, so none of the margin goes to them
Even if they put out some super high memory models and just pass the ram through at cost it would increase sales -- potentially quite dramatically and increase their total income a lot and have a good chance of transitioning to being a market leader rather than an also-ran. AMD has lagged so long because of the software ecosystem but the climate now is that they'd only need to support a couple popular model architect…
Lisa and Jensen are cousins. I think that explains it. Lisa can easily prove me wrong by releasing a high-memory GPU that significantly undercuts Nvidia's RTX 6000 Pro.
Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations
#243Earlier quoted context omitted.
GIGABYTE recently did this with their new 'AI' box https://www.gigabyte.com/Graphics-Card/GV-N5090IXEB-32GD
That misses the "vertically integrated" part. (As does everything else right now, which was my point.) The thing you linked is just a regular Gigabyte-branded 5090 PCIe GPU card (that they produced first, for other purposes; and which does fit into a regular x16 PCIe slot in a standard ATX chassis), put into a (later-designed) custom eGPU enclosure. The eGPU box has some custom cooling [that replaces the card's usual…
Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations
#244Earlier quoted context omitted.
Who said anything about the B50? Plenty of people use eg 2, 4 or 6 3090s to run large models at acceptable speeds. Higher VRAM at decent (much faster than DDR5) speeds will make cards better for AI.
If VRAM is ~$10/gb I suspect people paying $450 for a 12GB card would be happy to pay $1200 for a 64gb card. Running local LLM only uses about 3-6% of my GPU's capability, but all of it's VRAM. Local LLM has no need for 6 3090s to serve a single or handful of users; they just need the VRAM to run the model locally.
Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations
#245Earlier quoted context omitted.
DisplayPort is the superior option for monitors. High end gaming monitors will have DisplayPort inputs. Converting from DisplayPort to HDMI is trivial with a cheap adapter if necessary. HDMI is mostly used on TVs and older monitors now.
HDMI is still valuable for those of us who use KVMs. Cheap Display port KVMs don't have EDID emulation and expensive Display Port KVMs just don't work (in my experience).
Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations
#246Earlier quoted context omitted.
I’m interested in putting one of these in a server because of the relatively low power usage and compact size.
Why would you need a dedicated graphics card in a server? Usually you wouldn't even have a monitor connected.
Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations
#247Earlier quoted context omitted.
My guess would be video encoding/decoding and rendering.
Some Intel and AMD CPU come with an iGPU that you can use to transcode videos even some Xeons, there's no need to add a GPU just for that
Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations
#248Earlier quoted context omitted.
Put 32GB on that card and everybody would ignore performance issues. With 16GB everybody will just call it another in the long list of Intel failures.
It's already got 2x the ram and roughly 1.5x the performance of the more expensive NVidia competitor... I'm not sure where you are getting your expectations from.
Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations
#249Earlier quoted context omitted.
There is no point in using a low-bandwidth card like the B50 for AI. Attempting to use 2x or 4x cards to load a real model will result in poor performance and low generation speed. If you don’t need a larger model, use a 3060 or 2x 3060, and you’ll get significantly better performance than the B50—so much better that the higher power consumption won’t matter (70W vs. 170W for a single card). Higher VRAM wont make the…
Who said anything about the B50? Plenty of people use eg 2, 4 or 6 3090s to run large models at acceptable speeds. Higher VRAM at decent (much faster than DDR5) speeds will make cards better for AI.
Intel and even AMD can’t compete or aren’t bothering. I guess we’ll see how the glued 48GB B60 will do, but that’s a still relatively slow GPU regardless of memory. Might be quite competitive with Macs, though.
Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations
#250Earlier quoted context omitted.
Put 32GB on that card and everybody would ignore performance issues. With 16GB everybody will just call it another in the long list of Intel failures.
I wonder why everyone keep saying "just put more VRAM" yet no cards seem to do that. If it is that easy to compete with Nvidia, why don't we already have those cards?
Businesswise? Because Intel management are morons. And because AMD, like Nvidia, don't want to cannibalize their high end.
Technically? "Double the RAM" is the most straightforward (that doesn't make it easy, necessarily ...) way to differentiate as it means that training sets you couldn't run yesterday because it wouldn't fit on the card can now be run today. It also takes a direct shot at how Nvidia is doing market segmentation with RAM sizes.
Note that "double the RAM" is necessary but not sufficient.
You need to get people to port all the software to your cards to make them useful. To do that, you need to have something compelling about the card. These Intel cards have nothing compelling about them.
Intel could also make these cards compelling by cutting the price in half or dropping two dozen of these cards on every single AI department in the US for free. Suddenly, every single grad student in AI will know everything about your cards.
The problem is that Intel institutionally sees zero value in software and is incapable of making the moves they need to compete in this market. Since software isn't worth anything to Intel, there is no way to justify any business action isn't just "sell (kinda shitty) chip".