Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MacBook Pro with M5 Pro and M5 Max

apple.com

Post reply on HN
Print view View original

861–870 of 1001 posts

Re: MacBook Pro with M5 Pro and M5 Max

#861

Post by saagarjha »

fulafel wrote: post #747
oofbey wrote: post #724

Earlier quoted context omitted.

Token/s is entirely determined by memory bandwidth. TTFT is compute bound.

This is broadly correct for currently favoured software, but in computer science optimization problems you can usually trade off compute for memory and vice versa. For example just now from the front page: https://news.ycombinator.com/item?id=47242637 "Speculative Speculative Decoding" Or this: https://openreview.net/forum?id=960Ny6IjEr "Low-Rank Compression of Language Models Via Differentiable Rank Selection"

None of these really change the fundamental shape of the problem.

Re: MacBook Pro with M5 Pro and M5 Max

#862

Post by api »

manofmanysmiles wrote: post #114

I love the following section of their copy: > Even More Value for Upgraders > The new 14- and 16-inch MacBook Pro with M5 Pro and M5 Max mark a major leap for pro users. There’s never been a better time for customers to upgrade from a previous generation of MacBook Pro with Apple silicon or an Intel-based Mac. I read as "Whoops we made the M1 Macbook Pro too good, please upgrade!" I think I will get another 2-5 years…

I have an M1 Max. Splurged a little. It continues to be able to do huge builds and run mid tier open weights AI models at usable speed.

This does look like a nice machine though.

I’ll probably wait for the M6 Max. If/when RAM comes down they might stuff 192 or 256 gigs in one, which would make it able to run larger tier open weights models.

128 is kind of an uncanny valley for models. Bigger than you need for the mid tier and too small for the huge ones.

Re: MacBook Pro with M5 Pro and M5 Max

#863

Post by debian3 »

bluescrn wrote: post #816
dawnerd wrote: post #243

Earlier quoted context omitted.

My 32gb m1 max was probably the best purchase I've made. Still plenty of headroom in performance left in this beast. Wonder what reason they'll use to end software support in the future. Bet it'll be some security hardware they make up for the sake of forcing upgrades.

Shame the keycaps wear so poorly. Just a cosmetic issue, but on a £3k machine that’s otherwise amazing, it’s annoying to have keycaps that look rather dirty/greasy as they wear and develop shiny patches. (Can at least replace them via the self-service repair store. Fiddly job but worth it)

I was surprised to learn that they still replace the keyboard on m1 max when they service the battery. Probably you are due at this point. I just had mine done

Re: MacBook Pro with M5 Pro and M5 Max

#864

Post by saagarjha »

jmyeet wrote: post #106
Tangokat wrote: post #5

"Scaling up performance from M5 and offering the same breakthrough GPU architecture with a Neural Accelerator in each core, M5 Pro and M5 Max deliver up to 4x faster LLM prompt processing than M4 Pro and M4 Max, and up to 8x AI image generation than M1 Pro and M1 Max." Are they doubling down on local LLMs then? I still think Apple has a huge opportunity in privacy first LLMs but so far I'm not seeing much execution.…

Apple absolutely has a massive opportunity here because they used a shared memory architecture. So as most people in or adjacent to the AI space know, NVidia gatekeeps their best GPUs with the most memory by making them eye-wateringly expensive. It's a form of market segmentation. So consumer GPUs top out at 16GB (5090 currently) while the best AI GPUs (H200?) is 141GB (I just had to search)? I think the previou sgen…

There is a reason those data center GPUs are so expensive: it’s not trivial to “just” 5x the memory bandwidth.

Re: MacBook Pro with M5 Pro and M5 Max

#865

Post by saagarjha »

EagnaIonat wrote: post #780
wincy wrote: post #12

I typed “RAM” to search for it and boy they hammer home how lucky I am to be getting 1TB SSD standard, but no mention of RAM anywhere on this page. Anyway, the MacBook Pro starts with 16GB of RAM. It’s $400 to go from 16GB to 32GB. Interestingly, 36-128GB models are showing as “currently unavailable” on the store page, and you can’t even place an order for them right now? But for anyone curious, it’s quoting $5099 fo…

ARM RAM is not like your typical RAM. 16GB will easily run intensive software where you would x2+ on a windows machine. Unless you are planning to do some serious inferencing, or complex multi-agent setup, then you don't need the memory.

That’s not how RAM works

Re: MacBook Pro with M5 Pro and M5 Max

#866

Post by saagarjha »

stouset wrote: post #760
swyx wrote: post #367

Earlier quoted context omitted.

> The battery is wearing out a bit, but it started out life with so much runtime that losing a few hours doesn't seem to matter. this is my exact opposite experience. my M3 Max from 2 years ago now has <2hrs battery life at best. wondering if any experts here can help me figure out what is going on? what should i be expecting?

People here are suggesting limiting your battery charge as a proactive measure to prevent degradation but an M3 is far too new for you to be getting so poor battery life from use, even if you spent all day every day charging and discharging it. The only plausible answers are either: something you’re running is eating CPU/GPU cycles like crazy (browser tabs gone amok, background processes) or you have a defective batt…

This. The issue is not your battery but something running in the background.

Re: MacBook Pro with M5 Pro and M5 Max

#867

Post by saagarjha »

linsomniac wrote: post #515
hmottestad wrote: post #490

Earlier quoted context omitted.

My M3 Max can burn through battery much faster than my M1 Max ever could. And some apps are really inefficient. New Codex app drains my battery. If you are using Codex I recommend minimizing it, since it’s the UI that uses most power.

A couple weeks ago I was working remote and didn't bring a power adapter, and I realized a couple hours in that my battery was getting kind of low. I clicked on the battery icon and got a list of what was using a lot of power: 1 was an hour long video chat using Google Meet, the other was Claude desktop (which I hadn't used at all that morning). What in the world is an idle Claude Desktop doing that uses so much powe…

Electron?

Re: MacBook Pro with M5 Pro and M5 Max

#870

Post by john_alan »

butILoveLife wrote: post #856
VladVladikoff wrote: post #729

Earlier quoted context omitted.

I don’t really get why people are smack talking this, are there other laptops available that can do better?

My 2023 Nvidia 3060 laptop I spent $700 on?

you can't run models that are bigger than 16GB, not comparable.
Post reply on HN