Live data from Hacker News

Thelio Mira AI Linux Workstation: 192 GB GPU Memory

system76.com

31–40 of 134 posts

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#32
post #9

I thought it was a pricing mistake. But no, you just have to select the variations. $42,412.00

So a new car, or an AI rig. That's a bitter pill to swallow. Most of this is the cost of the Nvidia card, and the RAM.

SSD too. The priced have tripled...

It would be great if China had more lithography machine....

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#33

Earlier quoted context omitted.

So a new car, or an AI rig. That's a bitter pill to swallow. Most of this is the cost of the Nvidia card, and the RAM.

SSD too. The priced have tripled... It would be great if China had more lithography machine....

hoist by our own strategic export controls, rip

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#34
post #13

Earlier quoted context omitted.

They're [Max-Q] blower cards and there's a big gap between them so the cooling looks fine.

So the two variants they offer is the Max-Q and the Server edition one, but only explicitly mentioned for one? Edit: The Max-Q is one of the options, what's the other option then?

Seeing as it adds a second PSU, I'm guessing the workstation one.

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#35
Anyone know why they chose a consumer grade CPU on this? I’m a little surprised to see a 9950X as the top option. There’s not enough PCIe lanes available to run everything without bifurcation. I imagine the GPUs probably aren’t too bothered generally… but the NVMe drives are likely to slow down as a result.

A Threadripper ain’t cheap, but if you’re spending $45k on a workstation it seems like a weird place to skimp. Not to mention you’d then have the option of shoveling a few more 6000 pros in it when you want to run something larger (assuming your home/office electrical box can support it).

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#36

wouldnt you be better off maxing out the new Mac hardware? the memory bandwidth is insane on those jobbies

There’s roughly 50% more memory bandwidth on an RTX 6000 pro versus the M5 Ultra. I imagine it really comes down to what you’re doing, I know my 5090 runs laps around the M5 Pro I have when it comes to local LLM performance (until it runs out of memory).

If it wasn’t for the fact the 6000 Pro is selling for like 100% ($9,000) over MSRP it would probably look a lot more reasonable.

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#37
post #9

I thought it was a pricing mistake. But no, you just have to select the variations. $42,412.00

So a new car, or an AI rig. That's a bitter pill to swallow. Most of this is the cost of the Nvidia card, and the RAM.

I've noticed that some companies have flat out dropped the high memory configurations from their lineup that were offered just months ago at inflated prices. OnePlayerX had a 128GB Strix Halo tablet, RedMagic had a 24GB Android phone - both have been removed from their sites. It's a similar situation for the new Thinkpad lineup.

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#38
post #28

Earlier quoted context omitted.

I wonder why Apple has not really pushed their memory bandwidth numbers. They're starting to catch up to 2020 at this point -- cool, but still struggling to run years-old models. (FLOPS is even further behind by a year or two) Maybe they're waiting on HBM? Given that they're skipping M6 Max to go straight for M7, I'd assume they're doing a redesign for it.

GDDR has higher latency and much lower capacity. HBM requires an interposer and also has lower capacity. It's not an easy choice. The M7 family will probably double memory bandwidth using LPDDR6.

So the MacBooks might get roughly the M5 Ultra's bandwidth in a couple years. Not bad -- my M4 Max is currently stuck in 2016

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#39
post #15

This makes Mac Studio with 256GB memory look cheap in comparison. More memory to store weight at a quarter of the price!

It's gonna have WAY faster token rates than that Mac Studio though, enough to be a qualitative rather than quantitative difference.

At that price, it's competing against a cluster of M5 Mac Studios, which we don't have test data for yet.

Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory

#40

Earlier quoted context omitted.

So a new car, or an AI rig. That's a bitter pill to swallow. Most of this is the cost of the Nvidia card, and the RAM.

I've noticed that some companies have flat out dropped the high memory configurations from their lineup that were offered just months ago at inflated prices. OnePlayerX had a 128GB Strix Halo tablet, RedMagic had a 24GB Android phone - both have been removed from their sites. It's a similar situation for the new Thinkpad lineup.

[deleted]
Post reply on HN