Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

New Mac Studio with M5 Max and M5 Ultra

apple.com

Post reply on HN
Print view View original

511–520 of 570 posts

Re: New Mac Studio with M5 Max and M5 Ultra

#511

Post by abustamam »

baxtr wrote: post #466
abustamam wrote: post #423

Earlier quoted context omitted.

Sometimes I'll just pop into a meeting from my phone and walk around. That said , I do have a laptop but only because I go to the office every so often . Otherwise, I work exclusively from my home office because that's where my home desktop computer is and I control everything on my work computer from there.

Camera on or off? I love taking meetings while walking but since Covid everyone has their camera on making sedentary meetings mandatory.

Off now, but historically even at camera on companies I'd do whatever and just hold my phone when convenient for me or just shove the meeting in my pocket if I need my hands.

Obviously depends on your team culture, but try it :)

Re: New Mac Studio with M5 Max and M5 Ultra

#512

Post by ed_elliott_asc »

PaulRobinson wrote: post #81
joshstrange wrote: post #7

Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.

I've been thinking about this a fair bit recently. We make a lot of price/performance compromises for having an attached screen and keyboard on our computer. That was what got me started. Then I remembered the days of having to go to a special corner of the house to use a computer, vs now when I have a computer with me all the time. In my bag, on the sofa, on the train. Hell, I'm writing this on the work MBP while wa…

You don’t need to spend all that money to get your mojo back, make the changes that you would make I.e. leave the MacBook on your desk and see if life improves.

Re: New Mac Studio with M5 Max and M5 Ultra

#513

Post by jwr »

srmatto wrote: post #361
doctoboggan wrote: post #202

> Apple’s most powerful Mac raises the bar for local AI Wow, "Local AI" mentioned in the subheading above the fold - it's really awesome to see Apple leaning into this use case and I think it will definitely pay off for them going forward. Fingers crossed Apple is able to put some engineering effort towards shipping with one of the frontier open weight models included and optimized exactly for the machine.

I am absolutely open to being corrected but I can't think of a single current era FOSS project that apple is optimizing and shipping with their computers.

Shipping with their computers -- maybe not, but they did make FoundationDB open source (again) and are developing and maintaining it.

Re: New Mac Studio with M5 Max and M5 Ultra

#514

Post by jwr »

dakolli wrote: post #290
GodelNumbering wrote: post #150

1.2 TB/s bandwidth of M5 Ultra comes from two dies of M5 Max (each 614 GB/s) connected together using 4.4 TB/s inter-die fabric. For a non-quantized Deepseek V4 flash on an ultra, I would estimate about 1000+ tokens per second prefill and 50+ tokens per second on generation. This is actually quite usable and near parity to cloud. They mention "adds the GPU Neural Accelerators." which, if exploitable for LLM loads, wo…

How much would is the cost for that machine though, I'm pretty sure I could just buy tokens from a provider and never run out of money for 10 years, and get far better quality output because inference is being served by professionals on far better hardware and this machine would be obsolete long before that as well. Hosting local seems like a possibly the dumbest thing you could possibly do from an economics perspect…

The problem is when you don't want to send your data to any provider. Private documents, health information, all that is something you don't want to send anywhere, even if the provider makes a pinky promise that they won't use your data for training or store it.

And no, I do not use gmail, whatsapp or instagram :-)

Re: New Mac Studio with M5 Max and M5 Ultra

#516

Post by SwellJoe »

seanmcdirmid wrote: post #507
SwellJoe wrote: post #506

Earlier quoted context omitted.

Yes, if I was going to throw away ten grand on a computer that can run models that are much worse than what I can rent from a variety of providers for a few bucks a month, I'd buy the Apple.

Where are you getting DeepSeek for a few bucks a month? I spend around $3/day on it, sometimes $4.

I didn't mention DeepSeek, though with the caching effectiveness in Reasonix, you can get DeepSeek for pretty danged cheap directly from deepseek.com, even at the higher prices. I was referring to the many subscriptions available that will sell you quite a lot of usage for $20/month. Given how slow local inference is, you're probably not going to ever get your money back out of it if you just use it for inference (or training/fine-tuning, since you can rent GPUs for a buck or two an hour and ten grand is a lot of hours).

When memory prices come back down, I'll be down to the Apple Store. But, it doesn't make sense to buy hardware right now.

Re: New Mac Studio with M5 Max and M5 Ultra

#517

Post by zeusk »

olyjohn wrote: post #472
kridsdale1 wrote: post #294

Earlier quoted context omitted.

I’d say something like a PS4 is future proof. $350 got like 10 years of modern software.

Nobody calls a PS4 a computer. We all know it is internally with the hardware, but the whole package makes it not a computer.

PS4 is as close as it gets to the colloquial computer; it's a AMD APU running BSD with homebrew linux builds available.

And if not, would you consider a raspberry pi a computer? or your iphone a computer?

Re: New Mac Studio with M5 Max and M5 Ultra

#518

Post by toofy »

dakolli wrote: post #290
GodelNumbering wrote: post #150

1.2 TB/s bandwidth of M5 Ultra comes from two dies of M5 Max (each 614 GB/s) connected together using 4.4 TB/s inter-die fabric. For a non-quantized Deepseek V4 flash on an ultra, I would estimate about 1000+ tokens per second prefill and 50+ tokens per second on generation. This is actually quite usable and near parity to cloud. They mention "adds the GPU Neural Accelerators." which, if exploitable for LLM loads, wo…

How much would is the cost for that machine though, I'm pretty sure I could just buy tokens from a provider and never run out of money for 10 years, and get far better quality output because inference is being served by professionals on far better hardware and this machine would be obsolete long before that as well. Hosting local seems like a possibly the dumbest thing you could possibly do from an economics perspect…

you might want to do that, but you underestimate how much some hobbyists/makers/hackers value being able to do things on their own tools in their own house.

for me, it’s significantly more about the process than it is about penny pinching. it’s why im not an accountant and why i often despise bean counters.

my dad has soooo much money in tools alone for working on cars, faaar more than he’d ever spend at a mechanics. add in the costs he spends buying hobby cars and real estate/upkeep for the garage to work on his cars and it adds up quick. people spend a lot on their hobbies.

look at how much woodworkers spend on tools. look at how much homelabbers spend. photographers, boat/sailing wonks, horse owners, and on and on and on.

add in the above, then the value of the privacy aspects, idealism aspects, potential career knowledge, etc… and it’s obvious that local models will do well.

Re: New Mac Studio with M5 Max and M5 Ultra

#519

Post by aurareturn »

angoragoats wrote: post #463
aurareturn wrote: post #462

Earlier quoted context omitted.

[citation needed]. No need. You can infer the logic with this line I wrote: RTX 6000 wins in performance, if your model can fit into the VRAM. I'm not sure what the controversy is here.

You made claims about performance per watt and other metrics which were completely unsubstantiated and aren't backed up by the line you quoted. That's what I was asking for citations about.

What other metrics?

Re: New Mac Studio with M5 Max and M5 Ultra

#520

Post by mihaaly »

osmukka wrote: post #179

Reading this press release was almost physically painful, because of how much Apple loves to use the phrase "up to". In total it appears 46 times.

I am sure I'd love computer products more without the nauseating marketing bs. With dry boring technical facts only. I am repelled now, need more self drive and effort getting to the cashier, than without it.

(Scroll-oriented web pages see me running away fast. Not only Apple, which is a champion in it, but articles in general. That make me a passive spectator eating what they want me to eat, the way they want me to. Rather than a free discoverer. I hate being pushed into something. I like freedom.)

Post reply on HN