Apple Intelligence Foundation Language Models Tech Report 2025

Post by lxgr » Fri, Jul 18, 2025, 2:26 AM UTC

manoweb wrote: post #79

hu3 wrote: post #74

Earlier quoted context omitted.

First, most of the English speaking world is not native. "As of 2022, there were about 400 million native speakers of English. Including people who speak English as a second language, estimates of the total number of Anglophones vary from 1.5 billion to 2 billion." Second, all popular models I tested did well with that query, including Gemini on Android (aka "ok Google"), except Apple's. https://en.m.wikipedia.org/wi…

I am not sure why you go on the subject of English speaking world etc. Anyway, the models you tested with that query, which I am not sure why we think is a good benchmark, are local models running on a wireless device or they use datacenter and only convey the text back and forth?

Post by sxg » Fri, Jul 18, 2025, 2:32 AM UTC

al_borland wrote: post #112

a_wild_dandan wrote: post #103

Earlier quoted context omitted.

"You haven't contorted your comically simple query enough to make the brittle tool work. Throw the chicken bones better next time."

It’s been this way for over a decade. If someone hasn’t figured it out by now, that’s kind of on them. I’m not even sure why those two things would be asked as a single question. It seems like a very unnatural way to pose those two questions. Most humans would trip on that, especially if it was asked verbally.

Post by lxgr » Fri, Jul 18, 2025, 2:36 AM UTC

bayindirh wrote: post #19

jonplackett wrote: post #16

Every time I see a paper from Apple I just feel like, OK so why isn’t my iPhone actually doing any of this yet? Why give this to developers if you haven’t been able to get Siri to use it yet? Does it not work or something? I guess we’ll find out when devs start trying to make stuff

> why isn’t my iPhone actually doing any of this yet? Probably Apple is trying to distill the models so they can run on your phone locally . Remember, most, if not all, of Siri is running on your device. There's no round trip whatsoever for voice processing. Also, for larger models, there will be throwaway VMs per request, so building that infra takes time.

Post by [deleted] » Fri, Jul 18, 2025, 2:59 AM UTC

floam wrote: post #99

ivape wrote: post #31

Earlier quoted context omitted.

What’s the cost of pointing it to Private Cloud Compute? It can’t be free, can it?

It’s “free”, as in it doesn’t charge you anything or require a subscription: it’s a part of Apple Intelligence which is basically something bought with the device. It’s in the cloud so theoretically one shouldn’t need a quite new iPhone or Mac but - one does.

Post by smotched » Fri, Jul 18, 2025, 3:35 AM UTC

jonplackett wrote: post #64

imoverclocked wrote: post #20

Earlier quoted context omitted.

> why isn’t my iPhone actually doing any of this yet? What exactly are you referring to? Models do run on iPhone and there are features that take advantage of it, today.

None of those features are in any way interesting though. Image playground is a joke, Siri is a joke, that generative emoji thing is a joke. The AI stuff with photography sure, but that’s more like machine learning. The photo touch up thing is… useable? Sometimes? What is it you’ve been so impressed with?