Live data from Hacker News

Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

arstechnica.com

91–100 of 264 posts

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#91

The Mac Studio highest config was a great value for AI workloads though at least for inference and no one is reporting this….

Don't you need two 512GB ones for unquanted latest chinese models?

For consumers, there's little reason to run unquanted, especially for large models which take less of a hit from quantization. I'm running a 200b model at Q3 with very little degradation. A 1000b model would see even less change.

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#93

It's not a shortage, it's a cartel. https://www.youtube.com/watch?v=jVzeHTlWIDY

The video is 1 and half hour long. It's a whole documentary. Very detailed and well thought out, but too long for me at the moment. I'll see if its possible to get a summary somehow.

You can use Gemini or NotebookLM to summarize it

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#94
post #40

I think it's unlikely that Apple is paying the spot price for memory. They almost certainly negotiate delivery/price contracts in advance. Maybe the contract for the chips used in the 512GB model will expire soon?

15 years ago I was an intern at Micron and learned they passed on a contract with Apple because Apple insisted on discounts and there wasn't a compelling reason to reduce profit at Micron.

So yeah, Apple probably does pay less. But the market has enough demand that suppliers do say no.

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#95
post #38
post #35

Earlier quoted context omitted.

Unless you specifically need a pi (unlikely) then they really are awful value now. Hard to really go out of the way to support them now they've stuck two fingers up at the solo/indie/educational community and gone all enterprise. Second hand mini pc's are a good option. Half the price of a pi 5 + sd + power and you often get them with 16gb ram, a decent ssd, etc. If you need GPIO then many of the rockchip boards are…

Don't forget the case and fan. I think the RPi 3 was the last one you could comfortably run without a fan and not worry about it frying the SD card

I've had an rPi4 running a copy of a forum and server (for reference) in one of the fancy aluminum cases which passively cools for a couple of years now, no issues.

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#96
post #85

Earlier quoted context omitted.

Yea, wwdc is happening soon and the M5 ultra is in production . The new pricing will be respective on the highest config (768 gb is rumored) though.

M5 Max has still only 128GB RAM at most; one would expect 192GB if there was any indication M5 Ultra would have 768GB RAM?

The maximum memory configuration for the M3 Max MBP was also128GB.

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#98
post #85

Earlier quoted context omitted.

Yea, wwdc is happening soon and the M5 ultra is in production . The new pricing will be respective on the highest config (768 gb is rumored) though.

M5 Max has still only 128GB RAM at most; one would expect 192GB if there was any indication M5 Ultra would have 768GB RAM?

It is a rumor at this time and we are going from M3 to M5 on the Ultra not the M4 to the M5

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#99

Earlier quoted context omitted.

I haven't watched up the video but I went way too into the weeds of the ram crisis. I am not sure what the video suggests. This is my own understanding of the things after I got way too invested in why does OpenAI need all of this ram all of a sudden. (On a random tuesday) My understanding is TLDR: The stargate project had OpenAI,Oracle,Softbank etc. Softbank got the money from Japanese bank loan[0] at low interests…

Incredible digging. I remember reading comments about the reason the price hike was the Sam Altman secured a deal with the few ram producer in secrecy were they promised to reserve a large portion of their production to OpenAI for the next years (I don't remember how long). Supposedly Sam will just to put them in a warehouse to collect dust.

> Incredible digging

Thanks. I appreciate your kind words, I was thinking of writing some piece/blog about it but procastination is definitely something :) But I am just happy that I finally wrote a comment atleast explaining all/most of my understanding. That's more than fine for me.

> Incredible digging. I remember reading comments about the reason the price hike was the Sam Altman secured a deal with the few ram producer in secrecy were they promised to reserve a large portion of their production to OpenAI for the next years (I don't remember how long). Supposedly Sam will just to put them in a warehouse to collect dust.

I do believe that's gonna be the case as well. Most of the ram is probably not needed currently (thats what I feel like) so its gonna sit on dust, That, or oracle/microsoft will use it within their datacenters as old ram breaks apart to have some more monopoly given their close ties to OpenAI.

Even if OpenAI internally sells them at half the market price to microsoft/oracle, they still technically turn a profit.

I actually felt too conspiratorial thinking about it when I had first discovered it because I was under the previous assumption that OpenAI actually needed the ram myself too. But seeing recent events of OpenAI with Department of Defense, I definitely think that they did this on purpose.

Re: Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

#100
post #40

I think it's unlikely that Apple is paying the spot price for memory. They almost certainly negotiate delivery/price contracts in advance. Maybe the contract for the chips used in the 512GB model will expire soon?

It costs the same, we just mark it as an opportunity cost of unloading the memory on the spot market.

If I buy contracts for 1 gold bar at $500, and the gold price runs to $1200, I can either continue to market my gold-containing product for the same profit margin, or I can unload all that gold for $1200/bar and make a profit of $700/bar. If my profit margin is high and it doesn't take many gold bars to make a thousand units, maybe discontinuation doesn't make any sense. But if my product is "solid gold statuary of Dear Leader", and the bars are most of my cost basis, I know what I'd do.

Post reply on HN