I had hoped this was about Medusa Halo, but unfortunately, it's about 2025 technology. It's the same as Framework Desktop was at the end of last summer, which would have been a slightly silly but fun buy at $2k... I'd hope Mark Cerny / Sony launch PS6 sooner rather than later, as together with the upcoming LPDDR6 standard, it should trickle down to us in the local LLM mud eventually?
AMD Ryzen AI Halo – $4k AI Dev Kit
31–40 of 274 posts
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#32These devices were great when they were cheaper than the DGX Spark. But when they cost the same price (unless the Spark has shot up too), there's no reason to buy this over a Spark. The Spark is literally a faster version of this, with better software support. Edit: And I say that as an owner of a Ryzen AI Max 395 device.
I dropped a Framework mainboard in rack mount case and use it as a speedy low power x86 homelab as well as an inference server.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#33I had hoped this was about Medusa Halo, but unfortunately, it's about 2025 technology. It's the same as Framework Desktop was at the end of last summer, which would have been a slightly silly but fun buy at $2k... I'd hope Mark Cerny / Sony launch PS6 sooner rather than later, as together with the upcoming LPDDR6 standard, it should trickle down to us in the local LLM mud eventually?
> I hope Mark Cerny launches his PS6 sooner rather than later
With the current RAM and SSD prices... I rather a bit later.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#34It would be really nice if they included clustering support like a blueprint on how to buy several of these and cluster them to run the really large models in the best way possible.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#35256gbs memory bandwidth is about 1/4 that of a 3090. It would be a better buy with half the memory at 4x the speed.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#36Even a two-year-old Mac Studio outperforms this kit. A used unit with sufficient memory currently seems to offer the best price-to-performance ratio
"The Apple Silicon Mac Studios outperform the AMD Ryzen AI Max+ 395 machines"
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#37Even a two-year-old Mac Studio outperforms this kit. A used unit with sufficient memory currently seems to offer the best price-to-performance ratio "The Apple Silicon Mac Studios outperform the AMD Ryzen AI Max+ 395 machines"
A 2-year-old Mac Studio 128GB also sells for more.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#38Why do all similar products have a hard limit on the 128 GB VRAM part? For that price, I hoped to get at least 224 GB VRAM
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#39These devices were great when they were cheaper than the DGX Spark. But when they cost the same price (unless the Spark has shot up too), there's no reason to buy this over a Spark. The Spark is literally a faster version of this, with better software support. Edit: And I say that as an owner of a Ryzen AI Max 395 device.
Cheapest I've been able to get a DGX Spark FE is now around $4700 just FYI. This is from multiple vendors in higher-ed.
[deleted]
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#40I had hoped this was about Medusa Halo, but unfortunately, it's about 2025 technology. It's the same as Framework Desktop was at the end of last summer, which would have been a slightly silly but fun buy at $2k... I'd hope Mark Cerny / Sony launch PS6 sooner rather than later, as together with the upcoming LPDDR6 standard, it should trickle down to us in the local LLM mud eventually?
> I hope Mark Cerny launches his PS6 sooner rather than later With the current RAM and SSD prices... I rather a bit later.
True, this is the new reality though. My main gripe with Strix Halo is memory bandwidth and compute performance. Gaming performance sits squarely in base PS5 territory just as is the case with Steam Machine AFAIR; yet due to economies of scale "cheap" 2020 era PS5 still has higher memory bandwidth by quite a bit last time I checked.
PS6 "undertaker of physical media" will supposedly be priced >$1k: https://youtu.be/-F1JS-4Abjo