Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AMD Strix Halo RDMA Cluster Setup Guide

github.com

Post reply on HN
Print view View original

81–90 of 90 posts

Re: AMD Strix Halo RDMA Cluster Setup Guide

#81

Post by fodkodrasz »

fodkodrasz wrote: post #79
throwa356262 wrote: post #38

Earlier quoted context omitted.

Can you get these from vendors like Asus and lenovo these days? The ones I've seen on aliexpress are from unknown Chinese vendors.

I've had an ASUS PN-50E minipc, and its bios is broken and ASUS won't fix it, it cannot wake from sleep on Windown 11 25H2. Support told me to reinstall windows... and never got past level 1 support. I've also got a Beelink minipc, which also had some issues, and the unknown Chineese vendor did respond meaningfully to support email, and created a BIOS update in ~2 weeks after a driver update surfaced a firmware bug.…

out of edit time: so my main point: Beelink may be new to the business and relatively unknown, but my overall experience is very positive with them so far. Fr better than with some Big Brands.

Re: AMD Strix Halo RDMA Cluster Setup Guide

#82

Post by a96 »

nicman23 wrote: post #72
stymaar wrote: post #24

Earlier quoted context omitted.

> Last year you could buy a AI Max 395+ with 128G for 2.5k, now it's almost $4 Only if you pay the Framework premium. https://www.bosgamepc.com/products/bosgame-m5-ai-mini-deskto... I don't have access to the USD price, but it's 2500€ (tax included), up from 1600€ in November when I ordered mine.

that does not have thunderbolt / usb 5 though

Also probably an unknown china firmware instead of a supported one?

(Also no nazi bar)

Re: AMD Strix Halo RDMA Cluster Setup Guide

#83

Post by a96 »

nicman23 wrote: post #70
pixelpoet wrote: post #3

I have two 128gb Strix Halos and have been extremely excited about Antirez's (Redis author) work on DS4, especially with 4bit quant using two machines: https://github.com/antirez/ds4 Right now the speed isn't good for GLM 5.2, Deepseek V4 Flash speed is okay for me (actually reading the output) and quite usable. See kyuz0's great recent video here: https://www.youtube.com/watch?v=PkKXm_mKCCM With a bit more speed and…

if strix was 2k now i would insta buy 1

Check https://news.ycombinator.com/item?id=48705076

The top model is a little over 2k, though.

Re: AMD Strix Halo RDMA Cluster Setup Guide

#84

Post by sspiff »

fennecbutt wrote: post #77
sspiff wrote: post #32

Earlier quoted context omitted.

I had a Strix Halo laptop with 128GB which unfortunately died last week. I paid 2800 euro for it. If I buy the same machine today, the sticker price is 7899. The device was not perfect by any means, but the ability to run fairly large models is some kind of magic.

For that price surely you get the rtx pro with like 96GB and vastly superior compute?

Yes but it depends what you want. I didn't want to spend 8k (or now 11k) for a video card that I couldn't run without turning my home office into a boiler room and pay through the nose in electricity.

I wanted a laptop that could run some medium sized LLMs locally and experiment with. Strix Halo is great for that. But it was also 2800 euros for a 128GB premium laptop. Not 7899 like it is now.

Shame it broke out of warranty.

Re: AMD Strix Halo RDMA Cluster Setup Guide

#87

Post by Tepix »

olavgg wrote: post #48
Tepix wrote: post #18

What‘s the advantage of using ConnectX-5 Ex VPI NICs instead of much cheaper ConnectX-3 VPI NICs to connect two machines directly, other than PCIe 4.0 instead of PCIe 3.0? Can they offload more tasks when doing RDMA? Solid information is hard to come by.

Yes CX5 can offload more. I believe CX4 has similar offloading capabilities as CX3, except that it supports 100G. Another note: In my experience, RoCE works much better on CX4+ generation. CX3 is best with Infiniband. I think some firmwares on the CX3 generation, has a messed up config for RoCE. But running Infiniband is not a complex task, is way easier than people think, like 10x easier and faster to setup than Eth…

Thanks. Yes, I'm using Infiniband with CX3. Not seeing real speedups so far. I was wondering if upgrading to CX5 could help.

Re: AMD Strix Halo RDMA Cluster Setup Guide

#88

Post by Tepix »

Keyframe wrote: post #51
sspiff wrote: post #32

Earlier quoted context omitted.

I had a Strix Halo laptop with 128GB which unfortunately died last week. I paid 2800 euro for it. If I buy the same machine today, the sticker price is 7899. The device was not perfect by any means, but the ability to run fairly large models is some kind of magic.

everything strix halo went 2-3x bananas, same ballpark figures as apple hardware now and lead times on all of those are in months. Ridiculous where we ended up at.

The Bosgame M5 128GB went up 52% in price ($1840 -> $2799), so not 2-3x. And they are in stock. Still, a very big price increase.
Post reply on HN