AMD Ryzen AI Halo – $4k AI Dev Kit
11–20 of 274 posts
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#12Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#13Hardware is the exact same as what used to be available for $2K last year (and is still $1K cheaper from Chinese OEMs).
LTT Lab's LLM testing is getting more sophisticated, which is great - I think it's worth noting that ROCm/Vulkan versions and llama.cpp build versions are going to have some big differences for numbers.
For those wanting to get the most out of their Strix Halos, there's both kernel tweaks and utilities like ryzenadj that can help you get the most out of it. ( http://strixhalo.wiki/ has most of that documented). Also, if you're running for coding or agentic work, if you model supports MTP, that's mature and should give you a decent (30%?) decode boost.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#14$4k is pretty darn spendy. I recently purchased a refurbished Corsair AI Workstation with almost the same hardware (same chip, same 128GB RAM, but only 1TB storage) for $2160. Pretty good deal! Codex and I wrote a Linux driver to report the power mode of the device: https://github.com/pettijohn/corsair-ai-workstation-performa...
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#15How much are we going to pay for "AI kits" once the DRAM shortage is over? Will we be able to run a local model equivalent to the current AI frontier in sub $1000 hardware, even if dedicated, in 5 years?
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#16Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#17As traditionally AMD was a supplier of parts.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#18Does this have the same memory bandwidth problems as the spark?
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#19Bosgame is $2799 does the same thing if you plan to run only 1 of them
Only thing that separates them is the build quality and the extra 20W of boost the framework desktop and this variant support.
They have a note on the thermals but no measurement of noise. Doesn't matter if it's stricly a whoosh or a whine, only if they bother people in the same room. And the small ones like Bosgame get a consistent complaint about the noise in in-depth youtube videos.
Re: AMD Ryzen AI Halo – $4k AI Dev Kit
#20Are the likes of Dell and Lenovo not going to be annoyed that AMD are cutting them out? As traditionally AMD was a supplier of parts.