Live data from Hacker News

Apple Intelligence Foundation Language Models Tech Report 2025

machinelearning.apple.com

41–50 of 210 posts

Re: Apple Intelligence Foundation Language Models Tech Report 2025

#41

All I can say is, I asked Siri today (verbatim): What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit — and it offered a web search about fahrenheit. The "and" completely disabled its most basic ability to do metric conversions. So, it's nice to see Apple is doing research and talking about it, but we're out here waiting, still waiting, for anything useful to make of it all on our thousand-d…

>> What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit Probably wouldn't have made a difference but the second half of that statement isn't exactly clear. 85 degrees what? I also think when you're chaining these two separate calculations together you get a problem when it comes to displaying the results.

Meanwhile users have been conditioned to expect a system that understand the multiple queries and answers them appropriately.

Re: Apple Intelligence Foundation Language Models Tech Report 2025

#42

All I can say is, I asked Siri today (verbatim): What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit — and it offered a web search about fahrenheit. The "and" completely disabled its most basic ability to do metric conversions. So, it's nice to see Apple is doing research and talking about it, but we're out here waiting, still waiting, for anything useful to make of it all on our thousand-d…

>> What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit Probably wouldn't have made a difference but the second half of that statement isn't exactly clear. 85 degrees what? I also think when you're chaining these two separate calculations together you get a problem when it comes to displaying the results.

That exact phrase "What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit" given to ChatGPT produces the correct result (it infers that the second degrees must be Celsius) and ChatGPT gives me a nicely laid out formula for the math of the conversion.

So yeah, Apple is way behind on this stuff.

Re: Apple Intelligence Foundation Language Models Tech Report 2025

#43

Earlier quoted context omitted.

>> What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit Probably wouldn't have made a difference but the second half of that statement isn't exactly clear. 85 degrees what? I also think when you're chaining these two separate calculations together you get a problem when it comes to displaying the results.

Meanwhile users have been conditioned to expect a system that understand the multiple queries and answers them appropriately.

True. But for most of us, only in the past year. I have a few friends/relatives who have still never conversed with an LLM.

Re: Apple Intelligence Foundation Language Models Tech Report 2025

#44
Siri is literally a joke!

My son (he's 11 years old now and fairly skilled with all the main AI tools, eg chatgpt, gemini, etc) and I retry her every month or so, and this past time we just laughed. Can't handle basic questions - hears the question wrong, starts, stops, takes us to some random ass webpage, etc, etc.

"She's so jacked up!" he said.

Apple needs to get this under control and figured out, stat!

Re: Apple Intelligence Foundation Language Models Tech Report 2025

#45
post #38

The more I think about Apple, the more I realize that Apple is so far behind. While other companies are pushing the envelope (OpenAI, Anthropic, Google ..) Apple's ambitions seem much much smaller. And this is after they made very big claims with Apple Intelligence last year, when they had everyone fooled. This is like watching a train-wreck in slow motion.

I see it as the opposite. Apple is absolutely positioned to own "chat". I am not worried they'll soon sort things out — and eventually we'll have an LLM integrated into the iPhone; call it Siri or otherwise.

With my history encrypted in the cloud, and the trust that Apple has built around privacy ... I think they're going to come out alright.

Re: Apple Intelligence Foundation Language Models Tech Report 2025

#46
Here is my question…

This is the first time that millions of people will actually download and run a model on their own devices.

The question is… will Apple be constantly tweaking these models, or only during OS upgrades?

I for one really like local software. Call me old-fashioned, but I enjoy when a company doesn’t switch up software anytime on the server, or phone the results home all the time in order to extract more profits from their collective users.

Re: Apple Intelligence Foundation Language Models Tech Report 2025

#47

> We believe in training our models using diverse and high-quality data. This includes data that we’ve licensed from publishers, curated from publicly available or open- sourced datasets, and publicly available information crawled by our web-crawler, Applebot. > We do not use our users’ private personal data or user interactions when training our foundation models. Additionally, we take steps to apply filters to remo…

One problem with Apple's approach here is that they were scraping the web for training data long before they published the details of their activities and told people how to exclude them using robots.txt

Re: Apple Intelligence Foundation Language Models Tech Report 2025

#48

All I can say is, I asked Siri today (verbatim): What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit — and it offered a web search about fahrenheit. The "and" completely disabled its most basic ability to do metric conversions. So, it's nice to see Apple is doing research and talking about it, but we're out here waiting, still waiting, for anything useful to make of it all on our thousand-d…

> What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit

Err, what? As a native English speaker human that's a pretty confusing question to me, too!

Re: Apple Intelligence Foundation Language Models Tech Report 2025

#49

All I can say is, I asked Siri today (verbatim): What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit — and it offered a web search about fahrenheit. The "and" completely disabled its most basic ability to do metric conversions. So, it's nice to see Apple is doing research and talking about it, but we're out here waiting, still waiting, for anything useful to make of it all on our thousand-d…

>> What is 75 degrees fahrenheit in celsius, and what is 85 degrees in fahrenheit Probably wouldn't have made a difference but the second half of that statement isn't exactly clear. 85 degrees what? I also think when you're chaining these two separate calculations together you get a problem when it comes to displaying the results.

the fact is that gemini responds with this: 75 degrees Fahrenheit is 23.89 degrees Celsius, and 85 degrees Celsius is 185.00 degrees Fahrenheit.

Re: Apple Intelligence Foundation Language Models Tech Report 2025

#50

Earlier quoted context omitted.

To use their APIs at a discount, so what?

Apple aren’t paying OpenAI anything: https://www.bloomberg.com/news/articles/2024-06-12/apple-to-...

That's a big discount
Post reply on HN