Live data from Hacker News

Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

macrumors.com

41–50 of 327 posts

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#41
Being a Mac switcher since 2003 I am as much of a fanboy as anybody else but this quote from the article caught my attention, and smells like PR.

> Many AI tools are also Mac-first or Mac-only

I fail to recall AI tools Mac-only general purpose AI or agentic tools. Most of the claws, harnesses, studios and inference engines seem to be multiplatform. You can say you can run then in a Mac with a nicer UI wrapper or whatever, but "Mac-first" or "Mac-only"?

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#42
post #35

I don’t understand why they are not reintroducing the Apple Xserve?

Target audience - B2B. There are multiple videos of Steve Jobs saying that he hates B2B, because the people using the devices are not the ones making the purchasing decision. It is pretty much against Apples DNA, and all their B2B they have today is a means for them to sell more B2C.

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#43

Being a Mac switcher since 2003 I am as much of a fanboy as anybody else but this quote from the article caught my attention, and smells like PR. > Many AI tools are also Mac-first or Mac-only I fail to recall AI tools Mac-only general purpose AI or agentic tools. Most of the claws, harnesses, studios and inference engines seem to be multiplatform. You can say you can run then in a Mac with a nicer UI wrapper or what…

one. apfel.

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#44
post #24

If I had the capital I’d make an household inference appliance. No peripherals except Ethernet, integrated compute (cpu+gpu+mem) and secondary storage (+mobo, psu). No accoutrements, just the minimum amount of hardware to run a model as a utility. Even the appliance faceplate would be a display showing stats like an old HiFi stereo. Edit: something like a series of modules consisting of a RISC-V CPU + Vortex GPGPU +…

Is that the nvidia spark?

Yes, and a lot of others.

A bit too expensive for a home appliance though, isn't it?

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#45
post #24

If I had the capital I’d make an household inference appliance. No peripherals except Ethernet, integrated compute (cpu+gpu+mem) and secondary storage (+mobo, psu). No accoutrements, just the minimum amount of hardware to run a model as a utility. Even the appliance faceplate would be a display showing stats like an old HiFi stereo. Edit: something like a series of modules consisting of a RISC-V CPU + Vortex GPGPU +…

Isn't that what what George Hotz is doing over at tiny? https://tinycorp.myshopify.com/

Yes, but for inference. 45k is so far out of the budget of a professional unless you earn ridiculous money and have no dependents.

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#46

Earlier quoted context omitted.

The out-of-stock $6000 M3 Ultra Mac Studios with 800GB+ memory bandwidth are going for $24,000 on eBay, so yes definitely

Let me clarify, I think Apple could sell a device at the scale Apple sells at around the $10 to 25 thousand price point. Like, take out the price sheets for the Apple Car. Then sell me an AI tower at those price points.

[deleted]

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#48

Earlier quoted context omitted.

The out-of-stock $6000 M3 Ultra Mac Studios with 800GB+ memory bandwidth are going for $24,000 on eBay, so yes definitely

I don’t think we should use current prices as landmarks for large scale demand. That Studio’s current prices is inflated because of a (presumably) short term supply crunch, not because the average user is willing to pay $24k for a home AI inference device. It assumes that RAM remains supply constrained and that none of the existing RAM contracts are cut short. But Meta and xAI putting A TON of AI compute onto the mar…

What makes you think the supply crunch is short-term?

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#49
post #47

Apple doesn’t have an ads business, and it is inevitable that Google/openai/Anthropic are going to seek to monetise consumer ai via ads. So the ad free Apple on device experience will be welcome.

What does this mean? Apple ads bring in 8 billion revenue a year.

Re: Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

#50

Apple could probably sell a machine starting at $10,000 if they architected it as the sole place one’s Private Cloud Compute [1] ran. It would need a path to a $2,500 machine, I think. But this is a niche I don’t think another consumer-facing brand could do like Apple. [1] https://security.apple.com/blog/private-cloud-compute/

The out-of-stock $6000 M3 Ultra Mac Studios with 800GB+ memory bandwidth are going for $24,000 on eBay, so yes definitely

Not the same issue, but makes me nostalgic for these simpler times:

https://www.wired.com/2011/04/amazon-flies-24-million/

Post reply on HN