Live data from Hacker News

Thelio Mira AI Linux Workstation: 192 GB GPU Memory

system76.com

21–30 of 134 posts

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#23
post #15

This makes Mac Studio with 256GB memory look cheap in comparison. More memory to store weight at a quarter of the price!

It's gonna have WAY faster token rates than that Mac Studio though, enough to be a qualitative rather than quantitative difference.

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#25
post #22

Is it more powerful than Apple silicon, or why would anyone buy this? Just for Linux? Oh, it's System76, that's why. Open hardware. Makes sense. Edit: Also Nvidia

It is more powerful than Apple.

I wonder why Apple has not really pushed their memory bandwidth numbers. They're starting to catch up to 2020 at this point -- cool, but still struggling to run years-old models. (FLOPS is even further behind by a year or two)

Maybe they're waiting on HBM? Given that they're skipping M6 Max to go straight for M7, I'd assume they're doing a redesign for it.

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#26
post #15

This makes Mac Studio with 256GB memory look cheap in comparison. More memory to store weight at a quarter of the price!

It's gonna have WAY faster token rates than that Mac Studio though, enough to be a qualitative rather than quantitative difference.

Can't it be both?

EG As I gazed at Janice, joy with equal part contentment washed through my soul.

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#28
post #22

Earlier quoted context omitted.

It is more powerful than Apple.

I wonder why Apple has not really pushed their memory bandwidth numbers. They're starting to catch up to 2020 at this point -- cool, but still struggling to run years-old models. (FLOPS is even further behind by a year or two) Maybe they're waiting on HBM? Given that they're skipping M6 Max to go straight for M7, I'd assume they're doing a redesign for it.

GDDR has higher latency and much lower capacity. HBM requires an interposer and also has lower capacity. It's not an easy choice. The M7 family will probably double memory bandwidth using LPDDR6.

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#30
post #9

I thought it was a pricing mistake. But no, you just have to select the variations. $42,412.00

I had to do a double take myself, scrolled down and arrived at a similar number. Wish I built this a few years ago!

Yeah, I bought a Thelio Major three years ago. I'm kicking myself for not going dual-4090s for a mere $10K back then.
Post reply on HN