Apple can’t afford to run models, there are too many iPhones and not enough data centers.
Running on device is also risky because cycle limitations will make it seem dumb in comparison.
Apple Intelligence Foundation Language Models Tech Report 2025
71–80 of 210 posts
Re: Apple Intelligence Foundation Language Models Tech Report 2025
#72> We believe in training our models using diverse and high-quality data. This includes data that we’ve licensed from publishers, curated from publicly available or open- sourced datasets, and publicly available information crawled by our web-crawler, Applebot. > We do not use our users’ private personal data or user interactions when training our foundation models. Additionally, we take steps to apply filters to remo…
When Apple inevitably partners with OpenAI or Anthropic, which by their definition isnt doing "ethical crawling", I wonder how I should be reading that.
"Good artists copy; great artists steal"
- Famous Dead Person
Re: Apple Intelligence Foundation Language Models Tech Report 2025
#73Here is my question… This is the first time that millions of people will actually download and run a model on their own devices. The question is… will Apple be constantly tweaking these models, or only during OS upgrades? I for one really like local software. Call me old-fashioned, but I enjoy when a company doesn’t switch up software anytime on the server, or phone the results home all the time in order to extract m…
> The question is… will Apple be constantly tweaking these models, or only during OS upgrades?
Certainly when new updates are released--going from macOS 26 to 26.1).
They can probably push model updates between releases if necessary.
Re: Apple Intelligence Foundation Language Models Tech Report 2025
#74All I can say is, I asked Siri today (verbatim): What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit — and it offered a web search about fahrenheit. The "and" completely disabled its most basic ability to do metric conversions. So, it's nice to see Apple is doing research and talking about it, but we're out here waiting, still waiting, for anything useful to make of it all on our thousand-d…
> What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit Err, what? As a native English speaker human that's a pretty confusing question to me, too!
First, most of the English speaking world is not native.
"As of 2022, there were about 400 million native speakers of English. Including people who speak English as a second language, estimates of the total number of Anglophones vary from 1.5 billion to 2 billion."
Second, all popular models I tested did well with that query, including Gemini on Android (aka "ok Google"), except Apple's.
Re: Apple Intelligence Foundation Language Models Tech Report 2025
#75All I can say is, I asked Siri today (verbatim): What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit — and it offered a web search about fahrenheit. The "and" completely disabled its most basic ability to do metric conversions. So, it's nice to see Apple is doing research and talking about it, but we're out here waiting, still waiting, for anything useful to make of it all on our thousand-d…
Your usage of Siri today (probably on an old version of iOS) frankly has nothing to do with the article we are discussing. Sorry to say this but it is going to take time. Comparing the performance of a chatgpt running in a big data center with a model running locally on a phone device... give it a few years.
Re: Apple Intelligence Foundation Language Models Tech Report 2025
#76Despite all the “Apple is evil” or “Apple is behind” (because they don’t do evil). Well, what they made with the Foundation Model is great. The fact that they build a system within the Swift language that allows you to specify structured data models (structs) to be used like any other model in a modern programming language, and you actually get back generated data in that format is great. Unlike a lot of other AIs wh…
Guided generation is called "Structured Output" by other providers? Well partially generated content streaming thing is great and I haven't seen it anywhere else.
Sorry if I didn’t use the correct terms. Didn’t catch up on all the terminology coming from my native language. ;) But yes, I agree, the fact that parts, different parameters, of the model can be completed asynchronous by streaming the output of the model, is quite unique. Apple/swift was late with async/await, but putting it all together, it probably plays well with the ‘never’ (I know ) asynchronous and reactive coding.
Re: Apple Intelligence Foundation Language Models Tech Report 2025
#77Earlier quoted context omitted.
Only if you think they _must_ compete with large models on the internet.
I wouldn’t go as far as GP, but yes, absolutely, they must compete with large models on the internet. Customers are now used to being able to ask a computer a question and get something better than “I just ran a web search for what you said, here are the uncurated, unsummarized results”. Yes, this is in fact what people want. Apple is the biggest company in the world (don’t quibble this y’all, you know what I mean) a…
This usecase is run of the mill for someone like Google, who used to store and show you your location forever, but it's not in Apple style.
It's hard to be like "uhhh privacy" when you send all requests to a remote server where they're stored in clear text for god knows how long.
As of right now, there is no way to run big LLMs in a privacy preserving manner. It just doesn't exist. You can't E2EE encrypt these services, because the compute is done on the server, so it has to decrypt it.
There are some services which will randomize your instance and things like that, but that kind of defeats the a big part of what makes LLMs useful, context. Until we can run these models locally, there's no way to get around the privacy nightmare aspects of it.
Re: Apple Intelligence Foundation Language Models Tech Report 2025
#78The more I think about Apple, the more I realize that Apple is so far behind. While other companies are pushing the envelope (OpenAI, Anthropic, Google ..) Apple's ambitions seem much much smaller. And this is after they made very big claims with Apple Intelligence last year, when they had everyone fooled. This is like watching a train-wreck in slow motion.
When the Blackberry ruled the Earth, people asked 'Why doesn't Apple do a smartphone?'.
Re: Apple Intelligence Foundation Language Models Tech Report 2025
#79Earlier quoted context omitted.
> What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit Err, what? As a native English speaker human that's a pretty confusing question to me, too!
First, most of the English speaking world is not native. "As of 2022, there were about 400 million native speakers of English. Including people who speak English as a second language, estimates of the total number of Anglophones vary from 1.5 billion to 2 billion." Second, all popular models I tested did well with that query, including Gemini on Android (aka "ok Google"), except Apple's. https://en.m.wikipedia.org/wi…
I am not sure why you go on the subject of English speaking world etc.
Anyway, the models you tested with that query, which I am not sure why we think is a good benchmark, are local models running on a wireless device or they use datacenter and only convey the text back and forth?
Re: Apple Intelligence Foundation Language Models Tech Report 2025
#80> We believe in training our models using diverse and high-quality data. This includes data that we’ve licensed from publishers, curated from publicly available or open- sourced datasets, and publicly available information crawled by our web-crawler, Applebot. > We do not use our users’ private personal data or user interactions when training our foundation models. Additionally, we take steps to apply filters to remo…
> Using our web crawling strategy, we sourced pairs of images with corresponding alt-texts.
An issue for anti-AI people, as seen on Bluesky, is that they're often "insisting you write alt text for all images" people as well. But this is probably the main use for alt text at this point, so they're essentially doing annotation work for free.