Live data from Hacker News

Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations

guru3d.com

241–250 of 274 posts

Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations

#241
post #161

Earlier quoted context omitted.

because then instead of RAM bandwidth now you're dealing with PCIe BW which is way less.

Also less power efficient, takes up more PCI slots and a lot of software doesn't support GPU clustering. Already have 4x 16GB GPUs which is unable to run large models exceeding 16GB. Currently running them different VMs to be able to make full use of them, used to have them running in different docker containers however OOM Exceptions would frequently bring down the whole server, which running in VMs helped resolve.

What’s your application for high-VRAM that doesn’t leverage multiple gpus?

Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations

#242
post #75

Earlier quoted context omitted.

they don't manufacture RAM, so none of the margin goes to them

Even if they put out some super high memory models and just pass the ram through at cost it would increase sales -- potentially quite dramatically and increase their total income a lot and have a good chance of transitioning to being a market leader rather than an also-ran. AMD has lagged so long because of the software ecosystem but the climate now is that they'd only need to support a couple popular model architect…

> The failure to do so is inexplicable.

Lisa and Jensen are cousins. I think that explains it. Lisa can easily prove me wrong by releasing a high-memory GPU that significantly undercuts Nvidia's RTX 6000 Pro.

Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations

#243
post #240

Earlier quoted context omitted.

GIGABYTE recently did this with their new 'AI' box https://www.gigabyte.com/Graphics-Card/GV-N5090IXEB-32GD

That misses the "vertically integrated" part. (As does everything else right now, which was my point.) The thing you linked is just a regular Gigabyte-branded 5090 PCIe GPU card (that they produced first, for other purposes; and which does fit into a regular x16 PCIe slot in a standard ATX chassis), put into a (later-designed) custom eGPU enclosure. The eGPU box has some custom cooling [that replaces the card's usual…

Random observation: This is very similar to the rationale for the “trash can” Mac Pro.

Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations

#244
post #219

Earlier quoted context omitted.

Who said anything about the B50? Plenty of people use eg 2, 4 or 6 3090s to run large models at acceptable speeds. Higher VRAM at decent (much faster than DDR5) speeds will make cards better for AI.

If VRAM is ~$10/gb I suspect people paying $450 for a 12GB card would be happy to pay $1200 for a 64gb card. Running local LLM only uses about 3-6% of my GPU's capability, but all of it's VRAM. Local LLM has no need for 6 3090s to serve a single or handful of users; they just need the VRAM to run the model locally.

Exactly. People would be thrilled with a $1200 64GB card with ok processing power and transfer speed. It's a bit of a mystery why it doesn't exist. Intel is enabling vendors to 'glue' two 24GB cards together for a $1200 list price 48GB card, but it's a frankenstein monster and will probably not be available for that price.

Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations

#245

Earlier quoted context omitted.

DisplayPort is the superior option for monitors. High end gaming monitors will have DisplayPort inputs. Converting from DisplayPort to HDMI is trivial with a cheap adapter if necessary. HDMI is mostly used on TVs and older monitors now.

HDMI is still valuable for those of us who use KVMs. Cheap Display port KVMs don't have EDID emulation and expensive Display Port KVMs just don't work (in my experience).

Cheap DP to HDMI adapter cables are easily available if you need an HDMI port for that.

Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations

#246
post #113

Earlier quoted context omitted.

I’m interested in putting one of these in a server because of the relatively low power usage and compact size.

Why would you need a dedicated graphics card in a server? Usually you wouldn't even have a monitor connected.

I have an NVidia Tesla P40 in my home NAS/media server that I use for video encoding purposes. It doesn’t even have any video outputs, but it does have dual media encoders and a decent amount of VRAM for lots of (relatively) high quality simultaneous transcoding streams using NVENC/NVDEC to re-encode 4K Blu-ray remux’s on the fly.

Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations

#247
post #148

Earlier quoted context omitted.

My guess would be video encoding/decoding and rendering.

Some Intel and AMD CPU come with an iGPU that you can use to transcode videos even some Xeons, there's no need to add a GPU just for that

A lot of them don’t though. My Xeon doesn’t, so I threw a cheap used Nvidia Tesla P40 in there to do the job. Also it can handle a lot more simultaneous streams than any iGPU I’m aware of.

Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations

#248
post #123

Earlier quoted context omitted.

Put 32GB on that card and everybody would ignore performance issues. With 16GB everybody will just call it another in the long list of Intel failures.

It's already got 2x the ram and roughly 1.5x the performance of the more expensive NVidia competitor... I'm not sure where you are getting your expectations from.

But that Nvidia competitor seems like a pointless and overpriced card compared to Nvidia’s consumer GPUs.

Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations

#249
post #219
post #217

Earlier quoted context omitted.

There is no point in using a low-bandwidth card like the B50 for AI. Attempting to use 2x or 4x cards to load a real model will result in poor performance and low generation speed. If you don’t need a larger model, use a 3060 or 2x 3060, and you’ll get significantly better performance than the B50—so much better that the higher power consumption won’t matter (70W vs. 170W for a single card). Higher VRAM wont make the…

Who said anything about the B50? Plenty of people use eg 2, 4 or 6 3090s to run large models at acceptable speeds. Higher VRAM at decent (much faster than DDR5) speeds will make cards better for AI.

Nvidia has zero incentives to undercut their enterprise GPUs by adding more RAM to “cheap” consumer cards like the 5090.

Intel and even AMD can’t compete or aren’t bothering. I guess we’ll see how the glued 48GB B60 will do, but that’s a still relatively slow GPU regardless of memory. Might be quite competitive with Macs, though.

Re: Intel Arc Pro B50 GPU Launched at $349 for Compact Workstations

#250
post #123

Earlier quoted context omitted.

Put 32GB on that card and everybody would ignore performance issues. With 16GB everybody will just call it another in the long list of Intel failures.

I wonder why everyone keep saying "just put more VRAM" yet no cards seem to do that. If it is that easy to compete with Nvidia, why don't we already have those cards?

> If it is that easy to compete with Nvidia, why don't we already have those cards?

Businesswise? Because Intel management are morons. And because AMD, like Nvidia, don't want to cannibalize their high end.

Technically? "Double the RAM" is the most straightforward (that doesn't make it easy, necessarily ...) way to differentiate as it means that training sets you couldn't run yesterday because it wouldn't fit on the card can now be run today. It also takes a direct shot at how Nvidia is doing market segmentation with RAM sizes.

Note that "double the RAM" is necessary but not sufficient.

You need to get people to port all the software to your cards to make them useful. To do that, you need to have something compelling about the card. These Intel cards have nothing compelling about them.

Intel could also make these cards compelling by cutting the price in half or dropping two dozen of these cards on every single AI department in the US for free. Suddenly, every single grad student in AI will know everything about your cards.

The problem is that Intel institutionally sees zero value in software and is incapable of making the moves they need to compete in this market. Since software isn't worth anything to Intel, there is no way to justify any business action isn't just "sell (kinda shitty) chip".

Post reply on HN