Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MacBook Pro with M5 Pro and M5 Max

apple.com

Post reply on HN
Print view View original

381–390 of 1001 posts

Re: MacBook Pro with M5 Pro and M5 Max

#381

Post by caycep »

Tangokat wrote: post #5

"Scaling up performance from M5 and offering the same breakthrough GPU architecture with a Neural Accelerator in each core, M5 Pro and M5 Max deliver up to 4x faster LLM prompt processing than M4 Pro and M4 Max, and up to 8x AI image generation than M1 Pro and M1 Max." Are they doubling down on local LLMs then? I still think Apple has a huge opportunity in privacy first LLMs but so far I'm not seeing much execution.…

Given all the supply issues w/ Nvidia, I think Apple's AI strategy should be - local AI everything (not just LLMs), but also make Metal competitive w/ CUDA. Their ace in the hole is the unified memory model.

Re: MacBook Pro with M5 Pro and M5 Max

#382

Post by gjm11 »

pwython wrote: post #118

Well that's. Just. Great. I bought a 64GB M4 Max MBP last month. I'm past the 14-day return window. I figured the M5 was near, but assumed M5 Max would come a bit later. Not sure where I came up with that.

You can console yourself with the fact that your laptop, unlike one of the new ones if you'd bought that instead, can run macOS Sequoia (without "Liquid Glass") rather than Tahoe.

Re: MacBook Pro with M5 Pro and M5 Max

#383

Post by lamontcg »

Someone1234 wrote: post #100
Tangokat wrote: post #5

"Scaling up performance from M5 and offering the same breakthrough GPU architecture with a Neural Accelerator in each core, M5 Pro and M5 Max deliver up to 4x faster LLM prompt processing than M4 Pro and M4 Max, and up to 8x AI image generation than M1 Pro and M1 Max." Are they doubling down on local LLMs then? I still think Apple has a huge opportunity in privacy first LLMs but so far I'm not seeing much execution.…

Apple's AI strategy really kind of threads the needle cleverly. "AI" (LLMs) may or may not have a bubble-pop moment, but until it does Apple get to ride it on these press releases and claims. But if the big-pop occurs, then Apple winds up with really fantastic hardware that just happens to be good at AI workloads (as well as general computing). For example, image classification (e.g. face recognition/photo tagging),…

LLM usage is not very likely to "dry up".

What is more likely to happen though is that it doesn't take multiple $10B of datacenter and capital to build out models--and the performance against LLM benchmarks starts to max out to the point where throwing more capital at it doesn't make enough of a difference to matter.

Once the costs shrink below $1B then Apple could start building their own models with the $139B in cash and marketable securities that they have--while everyone else has burned through $100B trying to be first.

Of course the problem with this strategy right now is that Siri really, really sucks. They do need to come up with some product improvements now so that they don't get completely lapped.

Re: MacBook Pro with M5 Pro and M5 Max

#385

Post by zamadatix »

danudey wrote: post #334
GeekyBear wrote: post #332

Earlier quoted context omitted.

In previous generations, throughout was excellent for an integrated GPU, but the time to first token was lacking.

So throughput was already good but TTFT was the metric that needed more improvement?

To add to the sibling "good is relative" it also depends what you're running, not just your relative tolerances of what good is. E.g. in a MoE the decode speedup means the speed of prompt processing delay is more noticeable for the same size model in RAM.

Re: MacBook Pro with M5 Pro and M5 Max

#386

Post by abhikul0 »

niwtsol wrote: post #211
jsheard wrote: post #31

Earlier quoted context omitted.

> It’s $400 to go from 16GB to 32GB. No change from the previous models then, 16GB->32GB was already $400. They're cutting into their previously enormous margins to keep the prices stable, rather than hiking the prices to maintain their margins.

This is not exactly correct. If you have an M5 Pro chip instead of m5 Chip - I just built a 16inch, M5 Pro chip, it is $400 to go from 24 -> 48gb. An additional $200 ($600 over base) to go to 64gb. So the memory prices change based on chip. M5 Max Chip starts with 48gb of memory.

M5 Max starts at 36GB memory at $3599. M4 Max started at the same memory at $3199. They have doubled the default storage from 1TB to 2TB, that's a $400 increase I'm paying even if I don't want the extra 1TB.

Re: MacBook Pro with M5 Pro and M5 Max

#387

Post by 1123581321 »

swyx wrote: post #367
bob1029 wrote: post #244

I feel like Apple pulled an Instant Pot with the M1 MacBook Pro. I still haven't had a single situation where I felt like spending more money would improve my experience. The battery is wearing out a bit, but it started out life with so much runtime that losing a few hours doesn't seem to matter.

> The battery is wearing out a bit, but it started out life with so much runtime that losing a few hours doesn't seem to matter. this is my exact opposite experience. my M3 Max from 2 years ago now has <2hrs battery life at best. wondering if any experts here can help me figure out what is going on? what should i be expecting?

What is your maximum capacity in Settings > Battery Health? What processes are running with significant CPU? What's the typical temperature of the laptop according to a stats app? (Temperature is a good proxy for general energy use.)

I'm typing this on an M3 Max; its max battery capacity is 88%. I've got some things running (laptop average temp is 50-55C, fans off), screen is half brightness, and it's projected to go from 90% to 0% in five hours. I don't usually baby it enough to test this, but 8-10 hours should be achievable.

Re: MacBook Pro with M5 Pro and M5 Max

#388

Post by speedgoose »

kjkjadksj wrote: post #359
spiderice wrote: post #342

Earlier quoted context omitted.

Comparing the touchbar to a touch screen is silly

You are right the touch screen is even more stupid

It’s not. I had a thinkpad with a touchscreen and while I used the touchscreen seldomly, it was useful in some applications. Notably to easily develop touch based applications.

I have a M1 MacBook Pro with the touch bar since. It’s crap. I remember the keynote where they introduced it and a DJ mixed music using it. It was ridiculous that it got approved.

Re: MacBook Pro with M5 Pro and M5 Max

#389

Post by speedgoose »

swyx wrote: post #367
bob1029 wrote: post #244

I feel like Apple pulled an Instant Pot with the M1 MacBook Pro. I still haven't had a single situation where I felt like spending more money would improve my experience. The battery is wearing out a bit, but it started out life with so much runtime that losing a few hours doesn't seem to matter.

> The battery is wearing out a bit, but it started out life with so much runtime that losing a few hours doesn't seem to matter. this is my exact opposite experience. my M3 Max from 2 years ago now has <2hrs battery life at best. wondering if any experts here can help me figure out what is going on? what should i be expecting?

Also check which apps use the energy.

Re: MacBook Pro with M5 Pro and M5 Max

#390

Post by [deleted] »

SirMaster wrote: post #141
jmyeet wrote: post #106

Earlier quoted context omitted.

Apple absolutely has a massive opportunity here because they used a shared memory architecture. So as most people in or adjacent to the AI space know, NVidia gatekeeps their best GPUs with the most memory by making them eye-wateringly expensive. It's a form of market segmentation. So consumer GPUs top out at 16GB (5090 currently) while the best AI GPUs (H200?) is 141GB (I just had to search)? I think the previou sgen…

>So consumer GPUs top out at 16GB (5090 currently) 5090 has 32GB, and the 4090 and 3090 both have 24GB.

[deleted]
Post reply on HN