Considering it has again been proved with Fable that building your own business success dependent on other people's platforms is very risky, would you consider building your own stack? Perhaps not for coding, but for research and other tasks? If so, what combination of models could be the sweet spot?
Ask HN: Does it make sense to buy Mac Studio and run local models?
1–4 of 4 posts
Re: Ask HN: Does it make sense to buy Mac Studio and run local models?
#2Yes. I kick myself that I did not get the 500gb model when getting was good. It was a massive price tag, but the hardware is NICE. And that MLX architecture really works. I run the gpt-oss 100gb model and it's right quick.
Re: Ask HN: Does it make sense to buy Mac Studio and run local models?
#3In my opinion - not yet. The local models are getting better all the time, but still aren't quite reliable enough. Also, hardware prices are absurd right now. Once the hardware market settles down and there's a little more progress on local models, maybe in a year or two, I expect things will be a bit different.
I'm running a Strix Halo with 128GB of RAM. It's fun to play with, but the real frontier models are just way better.
Re: Ask HN: Does it make sense to buy Mac Studio and run local models?
#4A bit slow for coding, but just having a local model is worth it.