Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Intel announces Arc B-series "Battlemage" discrete graphics with Linux support

phoronix.com

Post reply on HN
Print view View original

131–140 of 722 posts

Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support

#131

Post by elorant »

Implicated wrote: post #101

12GB memory -.- I feel like _anyone_ who can pump out GPU's with 24GB+ of memory that are capable to use for py-stuff would benefit greatly. Even if it's not as performant as the NVIDIA options - just to be able to get the models to run, at whatever speed. They would fly off the shelves.

Would it though? How many people are running inference at home? Outside of enthusiasts I don't know anyone. Even companies don't self-host models and prefer to use APIs. Not that I wouldn't like a consumer GPU with tons of VRAM, but I think that the market for it is quite small for companies to invest building it. If you bother to look at Steam's hardware stats you'll notice that only a small percentage is using high-end cards.

Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support

#132

Post by teaearlgraycold »

declan_roberts wrote: post #86

I think a graphics card tailored for 2k gaming is actually great. 2k really is the goldilocks zone between 4k and 1080p graphics before you start creeping into diminishing returns.

Please say 1440p and not 2k. Ignoring arguments about what 2k should mean, there’s enough use either way that it’s confusing.

Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support

#133

Post by enragedcacti »

jmward01 wrote: post #103

12GB max is a non-starter for ML work now. Why not come out with a reasonably priced 24gb card even if it isn't the fastest and target it at the ML dev world? Am I missing something here?

> Am I missing something here?

Video games

Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support

#135

Post by GiorgioG »

crowcroft wrote: post #127

Anyone using Intel graphics cards? Aside from specs drivers and support can make or break the value prop of a gfx card. Would be curious what actually using is these is like.

I put an Arc card in my daughter's machine last month. Seems to work fine.

Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support

#136

Post by m00x »

Implicated wrote: post #101

12GB memory -.- I feel like _anyone_ who can pump out GPU's with 24GB+ of memory that are capable to use for py-stuff would benefit greatly. Even if it's not as performant as the NVIDIA options - just to be able to get the models to run, at whatever speed. They would fly off the shelves.

You can just use a CPU in that case, no? You can run most ML inference on vectorized operations on modern CPUs at a fraction of the price.

Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support

#137

Post by treprinum »

Muskyinhere wrote: post #114
treprinum wrote: post #75

Earlier quoted context omitted.

Inference on very large LLMs where model + backprop exceed 48GB is already way faster on a 128GB MacBook than on NVidia unless you have one of those monstrous Hx00s with lots of RAM which most devs don't.

No one is running LLMs on consumer NVidia GPUs or apple MacBooks. A dev, if they want to run local models, probably run something which just fits on a proper GPU. For everything else, everyone uses an API key from whatever because its fundamentaly faster. IF a affordable intel GPU would be relevant faster for inferencing, is not clear at all. A 4090 is at least double the speed of Apples GPU.

4090 is 5x faster than M3 Max 128GB according to my tests but it can't even inference LLaMA-30B. The moment you hit that memory limit the inference is suddenly 30x slower than M3 Max. So a basic GPU with 128GB RAM would trash 4090 on those larger LLMs.

Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support

#138

Post by bryanlarsen »

jmward01 wrote: post #103

12GB max is a non-starter for ML work now. Why not come out with a reasonably priced 24gb card even if it isn't the fastest and target it at the ML dev world? Am I missing something here?

These are $200 low end cards, the B5X0 cards. Presumably they have B7X0 and perhaps even B9X0 cards in the pipeline as well.

Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support

#139

Post by [deleted] »

shrewduser wrote: post #118
jmward01 wrote: post #103

12GB max is a non-starter for ML work now. Why not come out with a reasonably priced 24gb card even if it isn't the fastest and target it at the ML dev world? Am I missing something here?

these are the entry level cards, i imagine the coming higher end variants will have the option of much more ram.

[deleted]

Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support

#140

Post by oidar »

babypuncher wrote: post #105
gigaflop wrote: post #69

Earlier quoted context omitted.

Don't rent a GPU for gaming, unless you're doing something like a full-on game streaming service. +10ms isn't much for some games, but would be noticeable on plenty. IMO you want those frames getting rendered as close to the monitor as possible, and you'd probably have a better time with lower fidelity graphics rendered locally. You'd also get to keep gaming during a network outage.

I don't even think network latency is the real problem, it's all the buffering needed to encode a game's output to a video stream and keep it v-synced with a network-attached display. I've tried game streaming under the best possible conditions (<1ms network latency) and it still feels a little off. Especially shooters and 2D platformers.

Yeah - there's no way to play something like Overwatch/Fornite on a streaming service and have a good time. The only things that seems to be ok is turned based or platformers.
Post reply on HN