"hacker news"
Apple introduces M6 and M5 Ultra
451–460 of 1001 posts
Re: Apple introduces M6 and M5 Ultra
#452Rumors say that Apple will only release M6 base variant and skips M6 Pro, M6 Max and M6 Ultra variants to concentrate all efforts to create a good AI capable M7: "According to reports from Bloomberg, Apple will be skipping its M6 Pro, M6 Max, and M6 Ultra chips to accelerate development of the M7 chip. That means the only chip to be released from the M6 family will be the base M6. The reason for this break with tradi…
i sold my m3 ultra /512 for £14000, or about $18000. The difference is what is important to me for a new one, and assuming $6k or so for the 256->512 boost, my cost will be about $16k, so i’ll save $2k by upgrading to the top-of-the-range model, bar it being a 4TB drive
Re: Apple introduces M6 and M5 Ultra
#453I run a lot of local models (I am always experimenting) on my 32G M2-Pro MacMini - I would love to upgrade. The financial aspects don’t work however: I can learn and experiment with what I have for local models, and I pay as I go on FireWorks.ai for open model inferencing and no matter how much I use this service my monthly bill is between $10 and $40 and much faster than any reasonable home rig. Hybrid ‘small local’…
Honest question - why are you so stuck on Macs for local inference?
A 4 GPU linux box with 3090s, which are $1500 a piece right now, will blow this thing out of the water. Even 2x3090 rig will run most of the good local models like Gemma4:31b at 100+ tok/sec
The VRAM of the GPUs are MUCH faster than the unified ram within Apple Silicon. The only difference is the initial model load, which takes longer from disk to VRAM due to PCIE limitations, but once the model is loaded, GPUs can prefill and and generate tokens way faster than any Apple Silicon.
So is your desire to upgrade to mac because you just aren't aware of how to set up a GPU rig, or is it something else?
Re: Apple introduces M6 and M5 Ultra
#454Earlier quoted context omitted.
I've never heard of Mixtape, but I'm surprised to see such a weirdly contemptuous post about a video game get so much traction on HN. At a glance, critical review aggregators are showing 80+ on this game. Is there some drama or culture war issue here that I'm missing?
It's not a game, think of it as a long FMV sequence which barely requires any input at all through it all, except in one quicktime event.
Isn't that a pretty well-established genre going back at least to the 1980s? I'm pretty out of date on modern games, but I do remember Heavy Rain being widely acclaimed 15 years ago. There's gotta be something else that explains the vitriol against this new game.
Re: Apple introduces M6 and M5 Ultra
#455Earlier quoted context omitted.
The M6 doubled the neural engine from 16 to 32 cores. I would expect that the M7 doubles that again to 64 from 32? That would make sense. I believe that the CPUs are actually limited by ram bandwidth more than the neural engine right when it comes to LLM processing? Maybe the M7 introduces something new to get around the current ram bandwidth problems on the non-Ultra chips.
LPDDR6 is coming.
I understand that will boost read rates to around 14 Gbps as compared to the current 10 Gbps for LPDDR5X, so a 40% improvement.
Re: Apple introduces M6 and M5 Ultra
#456This fits neatly in the backpack with the MacBook Pro, if I need more compute power.
Re: Apple introduces M6 and M5 Ultra
#457Rumors say that Apple will only release M6 base variant and skips M6 Pro, M6 Max and M6 Ultra variants to concentrate all efforts to create a good AI capable M7: "According to reports from Bloomberg, Apple will be skipping its M6 Pro, M6 Max, and M6 Ultra chips to accelerate development of the M7 chip. That means the only chip to be released from the M6 family will be the base M6. The reason for this break with tradi…
Do current models run on the NPU or GPU? Wondering if Apple will have something like a TPU.
Apple has a dedicated "neural engine" which is designed as an inference NPU. Where as Google's TPU has a dual focus, both inference and training, which is a more complex design.
Re: Apple introduces M6 and M5 Ultra
#458Apple Studio with maxed out M5 Ultra, 256GB RAM and 16TB storage is 18,299$. The 512GB RAM version apparently is coming in October, considering that the difference between 96GB and 256GB is priced at 4000$, the 512GB upgrade must be eye watering. So, on the mini the RAM upgrade runs at 25$ per GB on all tiers, the same as the Studio therefore the upgrade to 512 will probably cost 6400$. The fully maxed out Apple Stud…
So is downpayment on a house. I would buy the house and just pay for tokens as needed. The house will get more valuable and that wealth would buy a lot of tokens in the future - which will probably get cheaper. EDIT: or buy AAPL. If I had bought Apple stock instead of buying a Mac LC II in 1992, then I would have about $2 million in Apple stock.
>The house will get more valuable
Depends on where you live. Also keep in mind population decline so long term, im not so sure. Prices already dropping in less desirable places (everywhere outside of most blue areas) (Assuming you are talking about the US sorry if not)
Re: Apple introduces M6 and M5 Ultra
#459Earlier quoted context omitted.
Lots of people use the Mac Mini to run the frontier models over night or while traveling. I have a rack in my basement and have thought about throwing one in. You can get a cheaper machine but Apple feels a little more, “rack and forget,” if you have less price sensitivity. Mac Mini + MacBook Neo w/ ssh can be a better setup than MacBook Pro for many people.
If it’s purely for experimentation then why not the DGX Spark/GB10? It’s up about 10% from release RRP which is quite good (you might argue it was overpriced then, but prosumer and workstation GPU prices are up 100% ). 4TB NVMe is not cheap these days - it’d cost at least $500 for a stick - and you get 128GB at a similar bandwidth to an M5 Pro. Nevermind that Apple still insists on providing base systems with only 51…
That does not sound like rack and forget. Just looking at prices it’s also way more expensive.
Re: Apple introduces M6 and M5 Ultra
#460I know, this is a bit of a meaningless comment, but it's funny in a way. Feels like late 90s again: - Xiaomi: We have matched Apple in CPU performance. - Apple: *Meep Meep...*
I do not find it funny tbh. I'm very very surprised that Xiaomi matches Apples speed even with the newest release, its not diminishing Xiaomis success.
They didn't. It's an off the shelf chip, the threads on that post dismantled it pretty thoroughly as a false claim.