Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Intel Announces Inference-Optimized Xe3P Graphics Card with 160GB VRAM

phoronix.com

Post reply on HN
Print view View original

91–100 of 131 posts

Re: Intel Announces Inference-Optimized Xe3P Graphics Card with 160GB VRAM

#91

Post by maeln »

jychang wrote: post #86
mawadev wrote: post #85

Honestly, Intel just has to build a GPU with insane amount of VRAM. It doesn't even have to be the fastest to compete... just a ton of vram for dirt cheap

It’s LPDDR5x It’s gonna be slowwww It’s gonna be what, 273GB/sec vram bandwidth at most? Might as well as buy an AND 395+ 128GB right now for the same inference performance and slightly less VRAM.

Slow is better than nothing. A card with this much VRAM in a "prosumer" price range would be really interesting right now for workstation, to work with big models.

Re: Intel Announces Inference-Optimized Xe3P Graphics Card with 160GB VRAM

#92

Post by electroglyph »

codedokode wrote: post #51
halJordan wrote: post #35

Earlier quoted context omitted.

Lpddr5x (not lpddr5) is 10.7 Gbps. Gddr7 is 32 Gbps. So it's going to be slower

Yes but in matrix multiplication there are O(N²) numbers and O(N³) multiplications, so it might be possible that you are bounded by compute speed.

both are equally important. compute for prefill and mem bandwidth for generation

Re: Intel Announces Inference-Optimized Xe3P Graphics Card with 160GB VRAM

#93

Post by numpad0 »

boomskats wrote: post #40
adastra22 wrote: post #37

Earlier quoted context omitted.

It was many generations before vector operations were moved onto graphics chips.

If you s/graphics/3d graphics does that still hold true?

2D images has (height, width, color), so they are Vector3

Re: Intel Announces Inference-Optimized Xe3P Graphics Card with 160GB VRAM

#94

Post by mft_ »

baq wrote: post #69
wmf wrote: post #45

Earlier quoted context omitted.

160 GB LPDDR5 is ~$1,200 retail so the card could be sold for $2,000. The price will depend on how desperate Intel is. Intel probably can't copy Nvidia's pricing.

It’d be a disaster for Intel if it sold for less than 3k, personally I think they’re aiming for break even at 5k a pop at least, and I wouldn’t be surprised to advertise 2x memory at half nvidia price, which would put it at ~15-20k? and a healthy margin which they need like oxygen now. Of course it’s all for naught if it doesn’t perform compute-wise.

I agree with you, based on standard business logic, but the question is whether Intel would be willing to sell a generation at break-even to disrupt, achieve a larger (and somewhat 'sticky') install base, developer engagement, a larger mind-share, etc.?

Re: Intel Announces Inference-Optimized Xe3P Graphics Card with 160GB VRAM

#96

Post by tonetegeatinst »

What price is this sitting at? Because if its software support is decent then Intel might have just managed to break into the hardware for AI on the edge. Examples like self hosted LLM finetuning and RAG on a old dell or HP server with these type of cards on them.

Re: Intel Announces Inference-Optimized Xe3P Graphics Card with 160GB VRAM

#97

Post by throwaway173738 »

bigmattystyles wrote: post #19

I remember Larabee and Xeon-Phi announcements and getting so excited at the time. So I'll wait but curb my enthusiasm.

I’m personally just thinking about how they treated their embedded Keem Bay line. Totally shitcanned without warning. I doubt they consider this a core market to the degree that they will endure bad sales numbers for a while.

Re: Intel Announces Inference-Optimized Xe3P Graphics Card with 160GB VRAM

#98

Post by tommica »

maeln wrote: post #90
tommica wrote: post #87

Earlier quoted context omitted.

Isn't this exactly that?

We don't know the pricing yet.

Fair... Hopefully it's consumer friendly. AI absolutely allows new companies to compete in the GPU context, but it's a surprise that no one has made an expansion card for AI usage. Computers have the PCIE slots for that purpose.

Re: Intel Announces Inference-Optimized Xe3P Graphics Card with 160GB VRAM

#100

Post by Aurornis »

tonetegeatinst wrote: post #96

What price is this sitting at? Because if its software support is decent then Intel might have just managed to break into the hardware for AI on the edge. Examples like self hosted LLM finetuning and RAG on a old dell or HP server with these type of cards on them.

> Examples like self hosted LLM finetuning and RAG on an old dell or HP server with these type of cards on them.

This won’t be in the price range of an old Dell server or a fun impulse buy for a hobbyist. 160GB of raw LPDDR5X chips alone is not cheap.

This is a server/workstation grade card and the price is going where the market will allow. Consider that an nVidia card with almost half the RAM is going to cost $8K or more. That price point is probably the starting point for where this will be priced, too.

Post reply on HN