Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MacBook Pro with M5 Pro and M5 Max

apple.com

Post reply on HN
Print view View original

711–720 of 1001 posts

Re: MacBook Pro with M5 Pro and M5 Max

#711

Post by razster »

bbshfishe wrote: post #666
butILoveLife wrote: post #447

Earlier quoted context omitted.

>Time to first token measured with an 8K-token prompt using a 14-billion parameter model with 4-bit quantization Oh dear 14B and 4-bit quant? There are going to be a lot of embarrassed programmers who need to explain to their engineering managers why their Macbook can't reasonably run LLMs like they said it could. (This already happened at my fortune 20 company lol)

Yeah no it didn’t. If you have a fully speced out M3/4 MacBook with enough memory you’re running pretty decent models locally already. But no one is using local models anyway.

I run a local model on the daily. I have it making tickets when certain emails come in and made a small that I can click to approve ticket creation. It follows my instructions and has a nice chain of thought process trained. Local LLMs are starting to become very useful. Not OpenClaw crap.

Re: MacBook Pro with M5 Pro and M5 Max

#712

Post by jki275 »

butILoveLife wrote: post #443
lastdong wrote: post #423

Earlier quoted context omitted.

14-billion parameter model with 4-bit quantization seems rather small

For anyone who has been watching Apple since the iPod commercials, Apple really really has grey area in the honesty of their marketing. And not even diehard Apple fanboys deny this. I genuinely feel bad for people who fall for their marketing thinking they will run LLMs. Oh well, I got scammed on runescape as a child when someone said they could trim my armor... Everyone needs to learn.

I run local models on my M1 Max. there are a number of them that are quite useful.

Re: MacBook Pro with M5 Pro and M5 Max

#713

Post by testing22321 »

_jab wrote: post #40
testfrequency wrote: post #15

I have a fairly maxed out M2 Ultra (24 cores, 192GB RAM), and still cannot get this machine to choke on anything. I have not once felt the need to upgrade in years, and that’s with doing pretty demanding 3D and LLM work.

I've found current-generation Macs so capable that I've switched to using a Macbook Air. Would strongly recommend - it's still a powerful machine and it's significantly lighter and cheaper.

Yep. I got a used M1 air with 16GB and 2TB. It’s still the fastest computer I’ve ever used.

Re: MacBook Pro with M5 Pro and M5 Max

#714

Post by mr_o47 »

manofmanysmiles wrote: post #114

I love the following section of their copy: > Even More Value for Upgraders > The new 14- and 16-inch MacBook Pro with M5 Pro and M5 Max mark a major leap for pro users. There’s never been a better time for customers to upgrade from a previous generation of MacBook Pro with Apple silicon or an Intel-based Mac. I read as "Whoops we made the M1 Macbook Pro too good, please upgrade!" I think I will get another 2-5 years…

Would it be worth upgrading from my M4 Pro 48GB to M5 Pro 64GB

Re: MacBook Pro with M5 Pro and M5 Max

#715

Post by xp84 »

zadikian wrote: post #569
abustamam wrote: post #547

Earlier quoted context omitted.

Wait, they throw them away, not sell or give to employees? I feel like as long as the computer is reset, indeed it is stupid to just throw it away instead of giving or selling it to someone who wants it.

They could resell, but maybe another way to phrase this, tying the screen to the obsolete computer greatly reduces the useful lifespan of the screen. But at that time, DisplayPort didn't do enough bandwidth to have that kind of display externally anyway.

At that time… not that they even allow the 4K present day iMacs to target display. So that wasn’t the reason.

Re: MacBook Pro with M5 Pro and M5 Max

#716

Post by bsimpson »

abustamam wrote: post #547
bsimpson wrote: post #394

Earlier quoted context omitted.

Nope - they removed that feature, so now come the end of the year, they're all e-waste. It feels really stupid to have to throw away a perfectly capable machine with 64GB of RAM in 2026.

Wait, they throw them away, not sell or give to employees? I feel like as long as the computer is reset, indeed it is stupid to just throw it away instead of giving or selling it to someone who wants it.

They recently started a resale program with decommissioned devices.

Re: MacBook Pro with M5 Pro and M5 Max

#717

Post by hx8 »

kobalsky wrote: post #289
dawnerd wrote: post #243

Earlier quoted context omitted.

My 32gb m1 max was probably the best purchase I've made. Still plenty of headroom in performance left in this beast. Wonder what reason they'll use to end software support in the future. Bet it'll be some security hardware they make up for the sake of forcing upgrades.

my tinfoil hat theory is that they make small features depend on new hardware. for example, let's say the new os depends on m5's exclusive thumbnail generator accelerator, and let's say it improves speed by a 20%. now, your M1 notebook than on previous OSes uses standard gpu acceleration for thumbnails will not have this specialized hardware acceleration, it will have software fallback that will be 90% slower. you wo…

You're too far down the rabbit hole. Anytime they can make M1 incompatible with the latest version of macOS which would most people to upgrade.

Re: MacBook Pro with M5 Pro and M5 Max

#720

Post by Nevermark »

Tangokat wrote: post #5

"Scaling up performance from M5 and offering the same breakthrough GPU architecture with a Neural Accelerator in each core, M5 Pro and M5 Max deliver up to 4x faster LLM prompt processing than M4 Pro and M4 Max, and up to 8x AI image generation than M1 Pro and M1 Max." Are they doubling down on local LLMs then? I still think Apple has a huge opportunity in privacy first LLMs but so far I'm not seeing much execution.…

• Having NPU cores since the M1, would seem to verify that running models has been a game plan for a while. LLMs coming along can only have increased that focus.

• Studios with Ultra Mx, now 4-way RDMA over Thunderbolt 5, and enormous RAM and SSD options, suggest a strong focus. I don't know what else that RAM would be intended for. Four Studio Ultras (total of 360 GPU cores with M5 Ultras?) with 2TB of unified RAM is a local model beast.

• They refashioned their GPU cores to better support both graphic and neural processing, despite already having focused NPU cores.

I would say they have been leaning into local models for several years.

I expect we will see more models being optimized for smaller sizes, as demand for them increases. With hardware performance and neural focus trending up, and model requirements/quality trending down, the next few years will be interesting times.

What would make me happy: Ultra x 2 (i.e. 2xUltra, 4xMax, 8xPro, 16xM5) packaging in the Studio. With 8-way RDMA. Mac Kong. Perhaps Apple will start making server cards again.

Post reply on HN