This is five months old now. Any substantial changes to the recommended setup?
It looks like the author has kept it updated since then. They mention the "Qwen3.5 (35B)" model for example which was released around 2 weeks ago.
Also, the entire setup was done through Codex. I asked Codex to figure out how to run models locally given my architecture (Ubuntu, AMD GPU). It told me which steps to apply and I hit zero snags.