Live data from Hacker News

Apple's On-Device and Server Foundation Models

machinelearning.apple.com

381–390 of 562 posts

Re: Apple's On-Device and Server Foundation Models

#381

Earlier quoted context omitted.

Yes but not evenly distributed, BeNeLux, Germany, Austria, and Nordic countries have a lot of iPhone users, while moving further east (or south) you see lower market share. Maybe it’s “two handfuls” of wealthy western countries rather than just one, but I think OPs point holds true.

In Poland it’s 33%

Poland seems to be 14%: https://gs.statcounter.com/os-market-share/mobile/poland

Re: Apple's On-Device and Server Foundation Models

#382
post #336

Earlier quoted context omitted.

Yes but not evenly distributed, BeNeLux, Germany, Austria, and Nordic countries have a lot of iPhone users, while moving further east (or south) you see lower market share. Maybe it’s “two handfuls” of wealthy western countries rather than just one, but I think OPs point holds true.

In Romania it's 24.7%

Huh interesting, I missed that. You’re right (actually I see even 25.5%).

Re: Apple's On-Device and Server Foundation Models

#383
post #322

Earlier quoted context omitted.

The interesting point here is that developers targeting the Mac can safely assume that the users will have a processor capable of significant AI/ML workloads. On the Windows (and Linux) side of things, there's no common platform, no assumption that the users will have an NPU or GPU capable of doing what you want. I think that's also why Microsoft was initially going for the ARM laptops, where they'd be sure that the…

I believe MS is trying to standardize this, in the same way as they do with DirectX support levels, but I agree it's probably going to be inherently a bit less consistent than Apple offerings

DirectML can use multiple backends.

Re: Apple's On-Device and Server Foundation Models

#384
post #318

Earlier quoted context omitted.

The interesting point here is that developers targeting the Mac can safely assume that the users will have a processor capable of significant AI/ML workloads. On the Windows (and Linux) side of things, there's no common platform, no assumption that the users will have an NPU or GPU capable of doing what you want. I think that's also why Microsoft was initially going for the ARM laptops, where they'd be sure that the…

That's probably where Microsoft's "Copilot+ PCs" come in.

Plus DirectML, wich as the name implies, builds on top of DirectX, allowing multiple backends, CPU, GPU, NPU.

Re: Apple's On-Device and Server Foundation Models

#385

Earlier quoted context omitted.

Still no manufacturer compares to the quality of apple screens and resolution …

Those screens are produced by samsung.

By your logic, I own a Foxconn smartphone with a FreeBSD-based OS. If you bought a Porsche, would you call it a Volkswagen?

Re: Apple's On-Device and Server Foundation Models

#386
I haven't seen anything indicating whether these features can be disabled. I'm not interested in adding a further invasion of privacy to my phone. I don't want some elaborate parlor trick helping me write. I've spent some time with ChatGPT and while it was somewhat novel, I wasn't overly impressed. Much of it was rudimentary and often wrong. And I wasn't overly impressed with some of the code that it generated. Reliance on such tools reminds me of an Asimov SF tale.

Re: Apple's On-Device and Server Foundation Models

#387
post #12

I'm disappointed that they make the fundamental claim that their cloud service is private with respect to user inputs passed through it and don't even a little bit talk about how that's accomplished. Even just an explanation of what guarantees they make and how would be much more interesting than explanations of their flavor of RLHF or whatever nonsense. I read the GAZELLE* paper when it came out and wondered what it…

Don't they do it in this linked article? https://security.apple.com/blog/private-cloud-compute/

The only two questions I would have would be, how often are they "periodically rebooted" and what are the predefined metrics logged/reported.

We may have some insight into the second point when the code is published.

Re: Apple's On-Device and Server Foundation Models

#388

[flagged]

It's censorship in the way that HN disallowing editorialising the submission title is censorship. Technically true, I guess, but not super helpful.

But it is not safety if you forbid talking about sex, if you want to learn about certain things which could be missused. Same as banning murder in video games. Same as banning books that deal with these topics. It's definitely closer to censorship than safety.

Re: Apple's On-Device and Server Foundation Models

#390

Earlier quoted context omitted.

The Steam Deck ships with 16 gigs of quad-channel LPDDR5 and it costs $400. Apple knows exaaaactly what they're doing with this sort of pricing. Can't forget about that cozy 256gb SSD either. An AI computer will need more than that, right?

RAM is literally the cheapest primary component in a laptop at going rate of 1-4usd/GB. I'd say that shipping 8GB base model in 2024 is clearly manipulation by Apple, i.e. planned obsolescence or a way to moat Apple software. Anyone who doesn't see this is just being delusional. Same way Apple and Samsung ship 128GB of storage when the production price between 128gb and 1tb is like 10$ (on a 1000$ device). Samsung ev…

On the number of devices they sell, an extra $64 of cost per device (taking your higher figure and assuming an extra 8GB), across Mac, iPad and iPhone, they'd be looking at a cost of ~$12.8bn a year. If they just did it for Mac, it's still in the region of $2bn/year.

Sure they could pass that onto a mostly price-insensitive audience, but they like round numbers, and it's not the size of decision you take without making sure its necessary: that your customers are going to go elsewhere in either scenario of doing it or not doing it.

Post reply on HN