Live data from Hacker News

Ask HN: I have $5k to spend on a local AI machine, what should I get?

news.ycombinator.com

11–20 of 23 posts

Re: Ask HN: I have $5k to spend on a local AI machine, what should I get?

#14
post #5

Be more specific - AI is a very broad field. nVidia GPUs have the best inference speed (particularly around SDXL, Hunyuan, Flux, etc), but unless you're buying several used 3090s SLI style, you're going to have to split larger LLM GGUFs across main memory and GPU. I'm excluding the RTX 5090 since two of them (plus tax) would basically blow your budget out the water. With Apple I think you can get up to 192GB of share…

I bought a fully tricked out Mac Studio and had planned to use it but I found I was far too busy in my final career and actually it sits idle. So, while I do not regret my decision based on what I knew at the time, my life trajectory has left it unused. So, I want to get back to doing LLM work on it for fun, Julia and R programming.
Post reply on HN