Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

macrumors.com

Post reply on HN
Print view View original

71–80 of 327 posts

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#71

Post by JumpCrisscross »

sajithdilshan wrote: post #68
JumpCrisscross wrote: post #64

Earlier quoted context omitted.

> cannot imagine a personal computing usage which can justify a 10k machine For me, the privacy pitch wins. I have a friend visiting, however, who spends like $2,400 with Anthropic every year. That's a solid ROI even if the thing becomes obsolete after a couple years. (I'm still on my 2020 MacBook Pro. I love it and will be sad when I have to replace it.)

> That's a solid ROI even if the thing becomes obsolete after a couple years. How can that be a solid return on investment? There's no model you can run locally to have frontier model level performance. Also who spends 2.4k yearly for personal AI usage, like what's the usecase? If your friend is spending that money for his business then it's not personal computing.

> There's no model you can run locally to have frontier model level performance

I'm betting he doesn't need a frontier model. Sonnet, today, is likely good for 80% of his tasks, which largely involve repretitive, tedious work.

> Also who spends 2.4k yearly for personal AI usage, like what's the usecase? If your friend is spending that money for his business then it's not personal computing

Combination of business and personal.

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#72

Post by fsuts »

amelius wrote: post #57
fsuts wrote: post #55

Earlier quoted context omitted.

They aren’t as aggressive and focus on the customer experience more than others, 8bn isn’t a lot for a company with their reach. For example Apple radio is a free product with no ads, Apple TV and Apple Music don’t have an ads supported tier.

You think Apple is a saint, but they have a completely locked down mobile computing/phone platform. Why the trust in them doing what is best for the user?

I didn’t say Apple are a saint

I said as they don’t push ads as much as others, the customer may be better

As ads focused services are designed to keep you there as long as possible rather than delivering what you are actually want quickly

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#73

Post by khurs »

People bought diesel cars as miles per gallon was higher than petrol.

People are buying apple unified as electricity costs in many countries are very high, so cheaper to run than Nvidia setup.

As non-apple unified memory options increase, many people will have more choose those

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#74

Post by amelius »

fsuts wrote: post #72
amelius wrote: post #57

Earlier quoted context omitted.

You think Apple is a saint, but they have a completely locked down mobile computing/phone platform. Why the trust in them doing what is best for the user?

I didn’t say Apple are a saint I said as they don’t push ads as much as others, the customer may be better As ads focused services are designed to keep you there as long as possible rather than delivering what you are actually want quickly

It's still wishful thinking. A better strategy is to not root for one player and vote (with your wallet) for more competition.

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#75

Post by byzantinegene »

IsTom wrote: post #54
uejfiweun wrote: post #48

Earlier quoted context omitted.

What makes you think the supply crunch is short-term?

If demand doesn't fall down or current manufacturers supply go up, somebody (presumably in China) will spin up fabs. Apple wanted to use blacklisted Chinese RAM already.

I am hopeful but I am not confident China has the capability to do it.

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#76

Post by techpression »

JumpCrisscross wrote: post #58
msdz wrote: post #53

Earlier quoted context omitted.

Unless the raw materials have an inherent limit on mining/production due to the amount present on the planet, why should or would companies not ramp up to eventually meet demand? Edit: Okay, this doesn’t mean that that’s actually possible in the short-term, so I think you’re right. But that means as the silver lining, in the medium term horizon there’ll be enough supply again? :’)

> why should or would companies not ramp up to eventually meet demand? Memory is a cyclical market that has historically rewarded conservatism [1]. Counterpoint: there is enough demand from enough capital-rich customers that they may be willing to shoulder the capital risk. [1] https://www.ldeepai.com/tech-hub/dram-industry-consolidation... Sorry for the slop link, it has a good chart from a solid source

Don't forget price fixing [1] which we are seeing clear indicators of happening right now too.

[1] https://en.wikipedia.org/wiki/DRAM_price_fixing_scandal

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#77

Post by wongarsu »

JumpCrisscross wrote: post #58
msdz wrote: post #53

Earlier quoted context omitted.

Unless the raw materials have an inherent limit on mining/production due to the amount present on the planet, why should or would companies not ramp up to eventually meet demand? Edit: Okay, this doesn’t mean that that’s actually possible in the short-term, so I think you’re right. But that means as the silver lining, in the medium term horizon there’ll be enough supply again? :’)

> why should or would companies not ramp up to eventually meet demand? Memory is a cyclical market that has historically rewarded conservatism [1]. Counterpoint: there is enough demand from enough capital-rich customers that they may be willing to shoulder the capital risk. [1] https://www.ldeepai.com/tech-hub/dram-industry-consolidation... Sorry for the slop link, it has a good chart from a solid source

For existing producers expanding capacity would be a risky move. But it's the perfect time for any newcomers to enter the market. Low yields and worse product don't matter as much right now, and by the time the market cools down you have everything dialed in and can compete on even ground

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#78

Post by anonym29 »

byzantinegene wrote: post #75
IsTom wrote: post #54

Earlier quoted context omitted.

If demand doesn't fall down or current manufacturers supply go up, somebody (presumably in China) will spin up fabs. Apple wanted to use blacklisted Chinese RAM already.

I am hopeful but I am not confident China has the capability to do it.

They're already doing it

https://www.techspot.com/news/112502-memory-prices-tipped-fa...

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#79

Post by musha68k »

huragok wrote: post #24

If I had the capital I’d make an household inference appliance. No peripherals except Ethernet, integrated compute (cpu+gpu+mem) and secondary storage (+mobo, psu). No accoutrements, just the minimum amount of hardware to run a model as a utility. Even the appliance faceplate would be a display showing stats like an old HiFi stereo. Edit: something like a series of modules consisting of a RISC-V CPU + Vortex GPGPU +…

Yes, just a big cool Cerebras wafer for the closet please.

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#80

Post by not-kinsale-joe »

huragok wrote: post #24

If I had the capital I’d make an household inference appliance. No peripherals except Ethernet, integrated compute (cpu+gpu+mem) and secondary storage (+mobo, psu). No accoutrements, just the minimum amount of hardware to run a model as a utility. Even the appliance faceplate would be a display showing stats like an old HiFi stereo. Edit: something like a series of modules consisting of a RISC-V CPU + Vortex GPGPU +…

Sounds like reinventing the home server.
Post reply on HN