When this was half the price of the DGX Spark, it made sense. But same price is a ridiculous premium for inferior performance but the ability to run Windows.
AMD Ryzen AI Halo – $4k AI Dev Kit
91–100 of 274 posts
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#92Earlier quoted context omitted.
A Mac Studio is a much better buy in terms of memory bandwidth, but impossible to buy in a 128 GB configuration. Honestly there aren’t great options right now and it’s probably better to wait for the market to be less insane.
I looked for one and it's impossible to find, let alone at a reasonable price + it does suffer from being harder to train/use less common models and workflows (e.g. arbitrary comfyui ones). Spark at least doesnt have that drawback, while AMD has both drawbacks. Waiting for the market to be less insane is somewhat akin to waiting for the s&p500 to drop a decent amount so you can buy in.
> Waiting for the market to be less insane is somewhat akin to waiting for the s&p500 to drop a decent amount so you can buy in.
lol this is so wrong it's funny - equities go up in price, commodity goods go down in price. the two markets are literally diametrically opposed.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#93These devices were great when they were cheaper than the DGX Spark. But when they cost the same price (unless the Spark has shot up too), there's no reason to buy this over a Spark. The Spark is literally a faster version of this, with better software support. Edit: And I say that as an owner of a Ryzen AI Max 395 device.
Cheapest I've been able to get a DGX Spark FE is now around $4700 just FYI. This is from multiple vendors in higher-ed.
I'm looking at Amazon and I see $4k GB10 devices right now (not an affiliate link) https://www.amazon.com/ASUS-Supercomputer-Superchip-Supports...
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#94Even a two-year-old Mac Studio outperforms this kit. A used unit with sufficient memory currently seems to offer the best price-to-performance ratio "The Apple Silicon Mac Studios outperform the AMD Ryzen AI Max+ 395 machines"
Comically, the 512 GB M3 Ultra Mac Studio that we tested isn't even available for purchase any more. The highest you can purchase from Apple is 96 GB.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#95Seems like having a big and clunky external power supply enables a smaller profile for the rest of the unit while making installation a bit more complex. How exactly is this thing going to be installed for use? Wouldn't it be easier to just have a bigger box with more shielding and heat dissipation?
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#96what can you realistically do with this ? $4k is a lot of money to spend on something like this without really being sure what models can reliably run
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#97So... I dont want to ruin gaming more but why not get a gaming PC? Figured this out 15 years ago if its good for gaming, put some more RAM in and boom you have a workstation...
The biggest problem is that if you want to run large (continuous memory) models, gaming graphics cards aren't sufficient, and if you manage to get graphics cards that you can chain it becomes a lot more expensive (and better performance) than these machines and GB10 machines.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#98The Mac beats it in all benchmarks, is probably more energy efficient, can add more ram, and is more cost efficient (?)… plus you get a Mac. This doesn’t even give you cuda. I’m not sure who this is for.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#99Earlier quoted context omitted.
A Mac Studio is a much better buy in terms of memory bandwidth, but impossible to buy in a 128 GB configuration. Honestly there aren’t great options right now and it’s probably better to wait for the market to be less insane.
I looked for one and it's impossible to find, let alone at a reasonable price + it does suffer from being harder to train/use less common models and workflows (e.g. arbitrary comfyui ones). Spark at least doesnt have that drawback, while AMD has both drawbacks. Waiting for the market to be less insane is somewhat akin to waiting for the s&p500 to drop a decent amount so you can buy in.
No, equities naturally trend up with economic growth. RAM is up because of a supply shock, as new capacity comes on prices will drop, it’s a commodity.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#100The Mac beats it in all benchmarks, is probably more energy efficient, can add more ram, and is more cost efficient (?)… plus you get a Mac. This doesn’t even give you cuda. I’m not sure who this is for.
The 128 GB Mac Studio is no longer sold and when they bring it back I predict it will be more expensive.