Live data from Hacker News

Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

arstechnica.com

161–170 of 264 posts

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#161
post #60

Earlier quoted context omitted.

>Apple buys and uses so much RAM across all its product lines that it’s in a better negotiating position than the likes of Framework or Raspberry Pi, but CEO Tim Cook acknowledged in the company’s last earnings call that memory pricing could begin to eat into Apple’s profit margins later this year.

There's also the fact that they were charging $200 to add 8GB of RAM before the prices went up, when that much RAM was something like $70 at retail . The problem then is that when the supply gets more expensive and you were already charging the maximally-extractive price to customers, they can't eat much more of a price increase, so instead most of it has to come out of margins.

I was configuring my M5 MBP preorder and 48=>64 was 250 EUR so not sure if they cut prices or your numbers are outdated ?

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#162

Now how am I supposed to develop Electron apps and use Chrome? In all seriousness, though, as one of the uninitiated, what would be the value of hosting LLMs on a machine like this that has a lot of memory that you pay for up front versus some sort of VPC-based approach?

One factor is that you may not be in a position to push your working data to a third party service, for security or legal reasons.

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#163
post #152

IMO its more nuanced. They're likely in production ramp-up of the M5 Ultra Mac Studio, for release in the next ~3 months; they have pre-purchased bins of memory from the supply-constrained major memory supplies; and they need as much as they can get because they want to push an M5 Ultra config to 768gb to continue the "you can run local models" story that the M5 Max Macbook Pro started telling last week. Going beyond…

Is Apple telling the "you can run local models" story, or is it third parties?

Yes Apple promotes local model capabilities in their marketing

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#164
post #61
post #10

I'm trying to work out if I should buy a 48GB M4 Pro Mac Mini now, or wait for M5 Pro ones later this year. For AI/ML purposes, mostly. As far as I can tell, the new M5 MacBooks didn't go up much or any for the same amount of RAM?

The AMD Strix Halo pc's are another option. I was also debating between a mac mini but decided to go the AMD route.

I'm eyeing that seriously too. Are you running linux on it by chance? Would love to hear from someone running linux on a non-Apple AI capable machine

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#165

Earlier quoted context omitted.

It used to mean that, but the new M5 Pro and M5 Max have separate CPU and GPU chiplets with an interposer, similar to how the previous generation Ultras were based on connecting two Max full dies. So it's unclear whether there will be any Ultra for the M5.

And here I was hoping they would put an M5 Ultra in a MacBook Pro. Maybe they will add it as an option to the 16” at a later date.

I wonder if the MacBook Pro can handle the thermal envelope of actually running an Ultra flat out.

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#166

Just got a strix halo ROG Z13 this month with soldered UMA memory, 128GB LPDDR5X-8000. It cost ~$3k. Amazon is selling 128GB memory kits @ 5600MHZ for $3k. I think there might be a market failure guys.

> Amazon is selling 128GB memory kits @ 5600MHZ for $3k. 128GB memory kits are not $3K. Closer to half of that. Amazon is not a good source of RAM pricing.

Where would you recommend sourcing RAM?

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#167

Earlier quoted context omitted.

There's also the fact that they were charging $200 to add 8GB of RAM before the prices went up, when that much RAM was something like $70 at retail . The problem then is that when the supply gets more expensive and you were already charging the maximally-extractive price to customers, they can't eat much more of a price increase, so instead most of it has to come out of margins.

I was configuring my M5 MBP preorder and 48=>64 was 250 EUR so not sure if they cut prices or your numbers are outdated ?

Prices in the US are usually much lower than in Europe. I just checked and 48->64 ram bump is still $200

I just did a 14" MBP with M5 Max, 128GB RAM, 4TB SSD, nano-texture display. Price difference is $5849 vs 7004 EUR ($8136).

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#168
post #152

IMO its more nuanced. They're likely in production ramp-up of the M5 Ultra Mac Studio, for release in the next ~3 months; they have pre-purchased bins of memory from the supply-constrained major memory supplies; and they need as much as they can get because they want to push an M5 Ultra config to 768gb to continue the "you can run local models" story that the M5 Max Macbook Pro started telling last week. Going beyond…

Is Apple telling the "you can run local models" story, or is it third parties?

Yes:

> A powerful Neural Accelerator is built into each GPU core of the M5 family of chips, which dramatically speeds up AI tasks like image generation from diffusion models, large language model (LLM) prompt processing, and on-device transformer model training. [1]

[1] https://www.apple.com/macbook-pro/

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#169
post #152

IMO its more nuanced. They're likely in production ramp-up of the M5 Ultra Mac Studio, for release in the next ~3 months; they have pre-purchased bins of memory from the supply-constrained major memory supplies; and they need as much as they can get because they want to push an M5 Ultra config to 768gb to continue the "you can run local models" story that the M5 Max Macbook Pro started telling last week. Going beyond…

What’s the price of that beast? #meCryingTearsOfBlood

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#170

Earlier quoted context omitted.

Slightly off-topic side remark: Every mathematician and computer scientist should feel deeply confused that the M... Ultra is more powerful than the M... Max. Why? Because if something is the maximum , there doesn't exist anything larger/better. :-)

They should use something simple, like AMD Ryzen AI Max+ Pro 395?

whataboutism doesn't make it any better, you know
Post reply on HN