Note: no power adapter included.
Not true everywhere. Only where required by law, so complain to your government.
MacBook Pro with M5 Pro and M5 Max
261–270 of 1001 posts
Re: MacBook Pro with M5 Pro and M5 Max
#262Earlier quoted context omitted.
I think its just marketing, and the marketing is working. Look how many people bought Minis and ended up just paying for API calls anyway. (Saw it IRL 2x, see it on reddit openclaw daily) I don't mind it, I open Apple stock. But I'm def not buying into their rebranding of integrated GPU under the guise of Unified Memory.
The biggest problem with personal ML workflows on Mac right now is the software.
I'm curious to know what software you're referring to.
Re: MacBook Pro with M5 Pro and M5 Max
#263[flagged]
I imagine the upcoming M5 Ultra will be competitive in this regard. The M3 Ultra already has 819GB/s and it's two generations behind.
Re: MacBook Pro with M5 Pro and M5 Max
#264On M4 Max 128GB we're seeing ~100 tok/s generation on a 30B parameter model in our from scratch inference engine. Very curious what the "4x faster LLM prompt processing" translates to in practice. Smallish, local 30B-70B inference is genuinely usable territory for real dev workflows, not just demos. Will require staying plugged in though.
The memory bandwith on M4 Max is 546 GB/s, M5 Max is 614GB/s, so not a huge jump. The new tensor cores, sorry, "Neural Accelerator" only really help with prompt preprocessing aka prefill, and not with token generation. Token generation is memory bound. Hopefully the Ultra version (if it exists) has a bigger jump in memory bandwidth and maximum RAM.
Do any frameworks manage to use the neural engine cores for that?
Most stuff ends up running Metal -> GPU I thought
Re: MacBook Pro with M5 Pro and M5 Max
#265You have to pay separately for the charger now. £99, what a bargain.
Since that is required by law, I suggest moving.
Re: MacBook Pro with M5 Pro and M5 Max
#266Earlier quoted context omitted.
> Look how many people bought Minis and ended up just paying for API calls anyway. (Saw it IRL 2x, see it on reddit openclaw daily) Aren't the OpenClaw enjoyers buying Mac Minis because it's the cheapest thing which runs macOS, the only platform which can programmatically interface with iMessage and other Apple ecosystem stuff? It has nothing to do with the hardware really. Still, buying a brand new Mac Mini for that…
There are so few used Mac Mini around, those are all gone and what is left is to buy new.
Worse than that, they hold their value, so buying a used M1 mini is still a few hundred bucks, and saving $200-300 by purchasing a 5 generation older mini seems like a bad deal in comparison.
Re: MacBook Pro with M5 Pro and M5 Max
#267Earlier quoted context omitted.
That's the broad developer community. 90%+ of the engineers at Big Tech and the technorati startups are on MacOS with 5% on Linux and the other 5% on Windows.
> 90%+ of the engineers at Big Tech and the technorati startups The US 1s? Is that why we have Deepseek and then other non-US open source LLMs catching up rapidly? World view please. The developer community is not US only.
You’ll see a lot of MacBooks in Beijing’s zhongguangcun where all the tech companies are, but they also have a lot of students there as well, so who knows. You need to go out to the suburbs where Lenovo has offices to stop seeing them. I know Apple is common in Western Europe having lived there for two years (but that was 20 years ago, I lived in China for 9 years after that).
It wouldn’t surprise me if the deepseek people were primarily using Mac’s. Maybe Alibaba might be using PCs? I’m not sure.
Re: MacBook Pro with M5 Pro and M5 Max
#268And your native CLI tools will continue to be from 2011 with 0 attention paid to the dev experience until it’s Swift, and we’ll continue to lock you out of running programs from other human beings we didn’t approve without a 6 step ritual in the OS. Oh and all apps will continue to constantly phone home i.e. pay for the machine so Google Adobe and Microsoft can run updaters and telemetry on it all day.
Or don’t use Google, Adobe or Microsoft software if that bothers you? And how is that Apple’s fault?
Re: MacBook Pro with M5 Pro and M5 Max
#269I love the following section of their copy: > Even More Value for Upgraders > The new 14- and 16-inch MacBook Pro with M5 Pro and M5 Max mark a major leap for pro users. There’s never been a better time for customers to upgrade from a previous generation of MacBook Pro with Apple silicon or an Intel-based Mac. I read as "Whoops we made the M1 Macbook Pro too good, please upgrade!" I think I will get another 2-5 years…
I read it the same way. I should've gotten way more RAM back when I got my M1 and RAM was still cheap although this was of course before the LLM boom so there was no way to really know.
I maxed my M1 out when I bought it because I was frustrated with the 16GB max in the previous machines. I use my machine for all sorts of things and some days you just don't feel like exiting apps to make space for new ones.
I still don't have a strong urge to upgrade. I could probably get by on 32GB (like my work-issued machine is) but 64GB is the right amount of headroom for me.
Re: MacBook Pro with M5 Pro and M5 Max
#270"Scaling up performance from M5 and offering the same breakthrough GPU architecture with a Neural Accelerator in each core, M5 Pro and M5 Max deliver up to 4x faster LLM prompt processing than M4 Pro and M4 Max, and up to 8x AI image generation than M1 Pro and M1 Max." Are they doubling down on local LLMs then? I still think Apple has a huge opportunity in privacy first LLMs but so far I'm not seeing much execution.…
> I still think Apple has a huge opportunity in privacy first LLMs This correlation of Apple and privacy needs to rest. They have consistently proven to be otherwise - despite heavily marketing themselves as "privacy-first" https://www.theguardian.com/technology/2019/jul/26/apple-con...
I think it's a little telling that the best you can do is a seven year old article.