Apple Intelligence Foundation Language Models Tech Report 2025

Post by rrrrrrrrrrrryan » Fri, Jul 18, 2025, 8:10 PM UTC

al_borland wrote: post #166

jamesrcole wrote: post #152

Earlier quoted context omitted.

A tool that can handle more than one question at a time is useful. Modern LLMs handle that with ease. So it's completely reasonable to be critical of that limitation.

Sure, what’s not reasonable is expecting Siri to be a modern LLM, when they know it’s not. They asked a question they knew Siri couldn’t handle just to slam it. I’m not critical of a 5-function calculator for not one-shotting complex equations like a computer. While Siri only does one thing at a time, I trust the answer more, because it’s doing the actual math and not just guessing what the most likely answer is, lik…

Post by Karrot_Kream » Fri, Jul 18, 2025, 9:13 PM UTC

barbazoo wrote: post #130

astrange wrote: post #80

Earlier quoted context omitted.

> Using our web crawling strategy, we sourced pairs of images with corresponding alt-texts. An issue for anti-AI people, as seen on Bluesky, is that they're often "insisting you write alt text for all images" people as well. But this is probably the main use for alt text at this point, so they're essentially doing annotation work for free.

> An issue for anti-AI people, as seen on Bluesky, is that they're often "insisting you write alt text for all images" people as well. But this is probably the main use for alt text at this point, so they're essentially doing annotation work for free. How did you come to the conclusion that those two groups overlap so significantly?

Post by lxgr » Sat, Jul 19, 2025, 12:33 AM UTC

ninkendo wrote: post #199

lxgr wrote: post #129

Earlier quoted context omitted.

As a user, I'd gladly opt into a slightly less deeply integrated Siri that understands what I want from it . Build a crude router in front of it, if you must, or give it access to "the old Siri" as a tool it can call, and let the LLM decide whether to return its own or a Siri-generated response! I bet even smaller LLMs would be able to figure out, given a user input and Siri response pair, whether the request was res…

> Build a crude router in front of it, if you must, or give it access to "the old Siri" as a tool it can call, and let the LLM decide whether to return its own or a Siri-generated response! Both of these approaches were tried internally, including even the ability for the LLM to rewrite siri-as-a-tool's response, and none of them shipped, because they all suck. Putting a router in front of it makes multi-turn convers…

Post by OldfieldFund » Sat, Jul 19, 2025, 6:08 PM UTC

bigyabai wrote: post #194

OldfieldFund wrote: post #186

Earlier quoted context omitted.

I think it's a great move that Apple is cautious with including a hardcore LLM in everything. They are not that useful to the regular user.

Nobody is forcing "hardcore LLM" features on anyone, besides maybe Microsoft. This is that same cope as "I'm glad Apple Car can't crash and threaten people's lives" despite the fact that... yunno, Apple really wanted to bring it to market. Siri, sideloading and AI features all all the same way; give people options and nobody will complain.

Post by 0x457 » Tue, Jul 22, 2025, 5:03 AM UTC

t1amat wrote: post #120

astrange wrote: post #119

Earlier quoted context omitted.

IIRC yaml is easier for models than json because you don't need as much recursive syntax.

I doubt this is true anymore, if ever. Both require string escaping, which is the real hurdle. And they are heavily trained on JSON for tool calling.