Live data from Hacker News

AMD Ryzen AI Halo – $4k AI Dev Kit

lttlabs.com

51–60 of 274 posts

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#51
I really want a 128gb+ machine but it's brutal to be at only 256 GB/s for $4k (especially with the drawbacks of both ARM and AMD).

I fear that by the time the RTX Spark comes out it'd have to be $6k, and by the time a 128gb or more machine with 700+ GB/s comes out it'd be at $10k, way out of most consumers' hands.

Edit: capitalized gb/s to GB/s.

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#52

These devices were great when they were cheaper than the DGX Spark. But when they cost the same price (unless the Spark has shot up too), there's no reason to buy this over a Spark. The Spark is literally a faster version of this, with better software support. Edit: And I say that as an owner of a Ryzen AI Max 395 device.

yeah, if only there wasn't some global hegemony that immediately drove up the price of all memory everywhere...

That's the rub... this platform was supposed to be around $1200-1400 maxed out, but now it's $4k, which is insane.

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#54
post #44

Why do all similar products have a hard limit on the 128 GB VRAM part? For that price, I hoped to get at least 224 GB VRAM

Because it’s a limit of the platform https://community.frame.work/t/was-there-no-possible-way-to-...

From the replies,

> A shame, really, as the Ryzen 7640U, 7840U, 7840HS, and 7940HS all support 256GB of RAM.

To be fair, those platforms support dual dimms per channel, which Strix Halo would not, at least not at it's high speeds.

But reciprocally Gorgon Halo 400 just launched and it supports... 192GB. And is the exact same APU.

Memory chips did finally have their first big doubling per chip semi recently (available last February), with 48 & 64GB dimms becoming available. There is some reasonable lag here, that Strix Halo & Gorgon Halonuse lpddr5x, which perhaps had some lag, that 32GB (x4) was the best available. But now with Gorgon Halo being 192GB capable but not 256GB, it sure feels looks & seems like this is just bad spirited fuckery from AMD. https://forum.level1techs.com/t/where-are-the-ddr5-unbuffere...

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#55
post #51

I really want a 128gb+ machine but it's brutal to be at only 256 GB/s for $4k (especially with the drawbacks of both ARM and AMD). I fear that by the time the RTX Spark comes out it'd have to be $6k, and by the time a 128gb or more machine with 700+ GB/s comes out it'd be at $10k, way out of most consumers' hands. Edit: capitalized gb/s to GB/s.

To be clear though that's GB/s. Which is 2 terabits/sec

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#57
post #7

How much are we going to pay for "AI kits" once the DRAM shortage is over? Will we be able to run a local model equivalent to the current AI frontier in sub $1000 hardware, even if dedicated, in 5 years?

When this hardware was announced, it was expected to be in the $1200-1400 range new... so, maybe. The real question is will the powers that be let this bubble burst, and how painful will the fallout be... I have a feeling it will be worse than 2001-2002.

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#59
post #15
post #7

How much are we going to pay for "AI kits" once the DRAM shortage is over? Will we be able to run a local model equivalent to the current AI frontier in sub $1000 hardware, even if dedicated, in 5 years?

frontier to laptop runnable open weight so far seems to be ~2 years latency, so maybe there's some hope

For that matter, just getting Chinese DRAM into the market could cool pricing down a lot to oppose the cartel.
Post reply on HN