None of the store links work. Weird. Is this not supposed to be a public page yet?
Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
171–180 of 722 posts
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#17212GB memory -.- I feel like _anyone_ who can pump out GPU's with 24GB+ of memory that are capable to use for py-stuff would benefit greatly. Even if it's not as performant as the NVIDIA options - just to be able to get the models to run, at whatever speed. They would fly off the shelves.
I don't know a single person in real life that has any desire to run local LLMs. Even amongst my colleagues and tech friends, not very many use LLMs period. It's still very niche outside AI enthusiasts. GPT is better than anything I can run locally anyway. It's not as popular as you think it is.
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#17312GB memory -.- I feel like _anyone_ who can pump out GPU's with 24GB+ of memory that are capable to use for py-stuff would benefit greatly. Even if it's not as performant as the NVIDIA options - just to be able to get the models to run, at whatever speed. They would fly off the shelves.
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#174Earlier quoted context omitted.
GDDR isnt like the ram that connects to cpu, it's much more difficult and expensive to add more. You can get up to 48GB with some expensive stacked gddr, but if you wanted to add more stacks you'd need to solve some serious signal timing related headaches that most users wouldn't benefit from. I think the high memory local inference stuff is going to come from "AI enabled" cpus that share the memory in your computer.…
They can use LPDDR5x, it would still massively accelerate inference of large local LLMs that need more than 48GB RAM. Any tensor swapping between CPU RAM and GPU RAM kills the performance.
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#175Too late, and it has a bad rep. This effort from Intel to sell discrete GPUs is just inertia from old aspirations, won't really help noticeably to save it, as there is not much money in it. Most probably the whole Intel ARC effort will be mothballed, and probably many more will.
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#176Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#177I haven't regretted the purchase at all.
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#17812GB memory -.- I feel like _anyone_ who can pump out GPU's with 24GB+ of memory that are capable to use for py-stuff would benefit greatly. Even if it's not as performant as the NVIDIA options - just to be able to get the models to run, at whatever speed. They would fly off the shelves.
100% - this could be Intel's ticket to capture the hearts of developers and then everything else that flows downstream. They have nothing to lose here -- just do it Intel!
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#179Earlier quoted context omitted.
The ML dev world isn’t a consumer mass market like PC gaming is.
Launching a new SKU for $500-1000 with 48gb of RAM seems like a profitable idea. The GPU isn't top-of-the-line, but the RAM would be unmatched for running a lot of models locally.
Re: Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
#18012GB max is a non-starter for ML work now. Why not come out with a reasonably priced 24gb card even if it isn't the fastest and target it at the ML dev world? Am I missing something here?
These are $200 low end cards, the B5X0 cards. Presumably they have B7X0 and perhaps even B9X0 cards in the pipeline as well.
B770 was rumoured to match the 16 GB of the A770 (and to be the top end offering for Battlemage) but it is said to not have even been taped out yet with rumour it may end up having been cancelled completely.
I.e. don't hold your breath for anything consumer from Intel this generation better for AI than tha A770 you could have bought 2 years ago. Even if something slightly better is coming at all there is no hint it will be soon.