111–120 of 1001 posts
The 512GB Ultra is amazing, sure. But who is it for exactly? VC funded big spender founders? In that case why would they need local AI? The ultra rich enthusiast? But there can't be too many of those. So who actually buys these?
Local AI is the future, and a lot of people want the first mover advantage or to toy around with it. I know a guy with a small rack of Nvidia Spark machines that he uses for that purpose; it's as much as a decent used car.
Even w/the pricing spike, inflation adjusted we are back to roughly the prices of a new Mac SE/30 for something that can beat a turing test w/o sweating. I yield the floor to no one when it comes to pessimism, but that's incredible.
Is there anything better now though?
All I see from AI, is an amplification of the enshittification of the internet.
And people being even more alone.
Apple Studio with maxed out M5 Ultra, 256GB RAM and 16TB storage is 18,299$. The 512GB RAM version apparently is coming in October, considering that the difference between 96GB and 256GB is priced at 4000$, the 512GB upgrade must be eye watering. So, on the mini the RAM upgrade runs at 25$ per GB on all tiers, the same as the Studio therefore the upgrade to 512 will probably cost 6400$. The fully maxed out Apple Stud…
Put together a similar build with a couple of rtx 6000 Ada cards and Apple's price tag suddenly looks pretty damn reasonable
Apple Studio with maxed out M5 Ultra, 256GB RAM and 16TB storage is 18,299$. The 512GB RAM version apparently is coming in October, considering that the difference between 96GB and 256GB is priced at 4000$, the 512GB upgrade must be eye watering. So, on the mini the RAM upgrade runs at 25$ per GB on all tiers, the same as the Studio therefore the upgrade to 512 will probably cost 6400$. The fully maxed out Apple Stud…
So is downpayment on a house. I would buy the house and just pay for tokens as needed. The house will get more valuable and that wealth would buy a lot of tokens in the future - which will probably get cheaper. EDIT: or buy AAPL. If I had bought Apple stock instead of buying a Mac LC II in 1992, then I would have about $2 million in Apple stock.
Also: "a staggering 1.2TB/s of unified memory bandwidth" -- yay, the GPU has reached the year 2020! (I'm a bit bitter that my M4 Max is near useless for local LLMs because of its low memory bandwidth.)
More validated by the day that my $450 M4 Mac Mini (16GB) was the best deal in computing for a long, long time.
- Xiaomi: We have matched Apple in CPU performance.
- Apple: *Meep Meep...*[dead]
When will Apple's Mx CPUs use Intel's 18A/18A-P/14A node(s)?