Earlier quoted context omitted.
To be clear though that's GB/s. Which is 2 terabits/sec
And 4000 USD is over 1.2 million Hungarian forints.
yea but 4000 USD dont get confused for Hungarian forints just because one says 4000 usd instead.
AMD Ryzen AI Halo – $4k AI Dev Kit
101–110 of 274 posts
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#10215 square cm box? Wow. Are there similar size, but less powered (and cheaper) workstations? I need a box that can build chromium reasonably fast and I would rather have something portable like this than a PC tower, but this is an overkill at $4k.
Look at Minisforum; they have a bunch of different models.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#103The Mac beats it in all benchmarks, is probably more energy efficient, can add more ram, and is more cost efficient (?)… plus you get a Mac. This doesn’t even give you cuda. I’m not sure who this is for.
This is for people that want an x86 machine instead of an ARM machine stranded on macOS.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#104I was in Gray Scott School for HPC last week, and even in scientific usage, CPU-only cases, AMD is still a pain point. Many tools and libraries don't have first class AMD support or any support at all.
It loses to Intel in CPU, and NVIDIA in GPU, in case of scientific libraries and HPC-worthy libs, tools.
I think people who want an "AI Dev Kit" will lean towards Intel + NVIDIA setup.
I am not a fan of Intel, but their MKL, MPI, etc. are not paralleled. Same goes for CUDA with NVIDIA.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#105Seems like having a big and clunky external power supply enables a smaller profile for the rest of the unit while making installation a bit more complex. How exactly is this thing going to be installed for use? Wouldn't it be easier to just have a bigger box with more shielding and heat dissipation?
External power supplies make UL certification cheaper; that's the reason. I hate power bricks but I have so many on my desk that one more makes no difference. The Beelink version has an internal PSU BTW.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#106Earlier quoted context omitted.
I looked for one and it's impossible to find, let alone at a reasonable price + it does suffer from being harder to train/use less common models and workflows (e.g. arbitrary comfyui ones). Spark at least doesnt have that drawback, while AMD has both drawbacks. Waiting for the market to be less insane is somewhat akin to waiting for the s&p500 to drop a decent amount so you can buy in.
> Waiting for the market to be less insane is somewhat akin to waiting for the s&p500 to drop a decent amount so you can buy in. lol this is so wrong it's funny - equities go up in price, commodity goods go down in price. the two markets are literally diametrically opposed.
I'd have a better portfolio right now if I invested in RAM instead of equities.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#107This is just a little under the price of NVidia's DGX Spark with CUDA or a Mac with 128GB and twice the memory bandwidth. The point of Strix Halo used to be that it was half the price of those way more capable machines. You'd be crazy to buy the AMD chip at this price. But the hardware market is generally crazy right now, so I'm sure this will sell as well, unfortunately.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#108Earlier quoted context omitted.
The spark also has 128GB VRAM (same type) and by recently I mean I bought them last week for $3999 each.
yeah, so $500 spread https://www.microcenter.com/product/699008/nvidia-dgx-spark is what the current price appears to be. The differences are basically, sparks require ARM and sparks allow interconnects; so if you do have dreams of electric sheep to chain them together, you're not gonna get the AMD halo units. But if you just want to putz around with a dev machine and do other things, not sure you'd want a spark.
They had it on sale last week for $3999, it will likely happen again. Also if you are willing to buy ASUS/Acer/MSI you can get them cheaper, in the same range as well. Those units are identical (mainboard/ram/chipset/connectivity), they only tend to differ in SSD being offered.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#109Even a two-year-old Mac Studio outperforms this kit. A used unit with sufficient memory currently seems to offer the best price-to-performance ratio "The Apple Silicon Mac Studios outperform the AMD Ryzen AI Max+ 395 machines"
I imagine there may be users who can’t use macOS, or maybe they want the ability to upgrade storage.
The framework desktop even has a usable PCIe 4x slot available if you put the board in a different case. They sell the 128GB board on its own for $3150.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#110Earlier quoted context omitted.
> just make even cheapest CPUs support 8/16 DDR4 channels Isn't adding pins kind of expensive?
Well to be honest, there are a lot of NOOP pins on CPUs, but using them basically means fabbing a new die altogether, which is basically making a whole new CPU altogether.
This is an odd comment. Pins are seriously expensive. Companies don't just throw them in for fun. Usually they're necessary for signal integrity or packaging constraints.