Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple Foundation Models

platform.claude.com

Post reply on HN
Print view View original

11–20 of 244 posts

Re: Apple Foundation Models

#11

Post by _the_inflator »

pprotas wrote: post #6
daniel_iversen wrote: post #4

Is this Apple encouraging developers to go through their api abstraction layer to use LLMs so that when they launch their own (which I think we’ve heard they’ve been spending lots of money on training and might be somehow involved with Siri or current Apple AI?) that they can easily help devs make a seamless transition? Or is it just a developer nicety or something else?

The cynic (or realist?) in my thinks this abstraction layer is Apple's way of making sure that users give their own Apple Intelligence credit for the underlying LLM functionality, even if another company is actually providing the LLM.

Assembled in Cupertino once more. ;)

Re: Apple Foundation Models

#13

Post by [deleted] »

pprotas wrote: post #6
daniel_iversen wrote: post #4

Is this Apple encouraging developers to go through their api abstraction layer to use LLMs so that when they launch their own (which I think we’ve heard they’ve been spending lots of money on training and might be somehow involved with Siri or current Apple AI?) that they can easily help devs make a seamless transition? Or is it just a developer nicety or something else?

The cynic (or realist?) in my thinks this abstraction layer is Apple's way of making sure that users give their own Apple Intelligence credit for the underlying LLM functionality, even if another company is actually providing the LLM.

[deleted]

Re: Apple Foundation Models

#14

Post by NorwegianDude »

daniel_iversen wrote: post #4

Is this Apple encouraging developers to go through their api abstraction layer to use LLMs so that when they launch their own (which I think we’ve heard they’ve been spending lots of money on training and might be somehow involved with Siri or current Apple AI?) that they can easily help devs make a seamless transition? Or is it just a developer nicety or something else?

A dark, but not totally unfair take: It makes it easier for Apple to take payment for the models others provide, and even allows Apple, if they want to, to use the data to build a dataset for training their own models based on how users use third party models. It's only on Apple devices this API is used, so they split up the market by not letting developers use the same system if they want things to work on iOS, locking users even more in.

Re: Apple Foundation Models

#15

Post by tarcon »

daniel_iversen wrote: post #4

Is this Apple encouraging developers to go through their api abstraction layer to use LLMs so that when they launch their own (which I think we’ve heard they’ve been spending lots of money on training and might be somehow involved with Siri or current Apple AI?) that they can easily help devs make a seamless transition? Or is it just a developer nicety or something else?

Apple has some clever mechanics to protect user data. I had to work with App tracking stuff lately and their approach to keeping user details private with anonymized cohorts (SKAN, Differential Privacy) before reporting tracking events to third party platforms was surprisingly well thought out. There is value in having them in your loop if you care about privacy.

Re: Apple Foundation Models

#16

Post by rock_artist »

While I'm happy with Apple introducing this abstraction. my main concern was with local models.

I'd love using Gemma4 as an example. but thinking of a user. if 10 Apps each uses same model and downloads it, the phone will be bloated.

I still didn't understand if Apple provided a way for multiple apps uses same on-device model (without tricky namespaces and permissions).

I didn't see anything suggesting that's the case.

Re: Apple Foundation Models

#17

Post by mlpicker »

What I'm curious about is whether this is actually on-device. Apple's framework caps local models around 3B params last I looked, and Claude is way bigger than that. So either there's some hybrid setup I haven't seen documented, or this is mostly a Claude SDK in FM clothing. Anyone tried it on a plane?

Re: Apple Foundation Models

#18

Post by oefrha »

NorwegianDude wrote: post #14
daniel_iversen wrote: post #4

Is this Apple encouraging developers to go through their api abstraction layer to use LLMs so that when they launch their own (which I think we’ve heard they’ve been spending lots of money on training and might be somehow involved with Siri or current Apple AI?) that they can easily help devs make a seamless transition? Or is it just a developer nicety or something else?

A dark, but not totally unfair take: It makes it easier for Apple to take payment for the models others provide, and even allows Apple, if they want to, to use the data to build a dataset for training their own models based on how users use third party models. It's only on Apple devices this API is used, so they split up the market by not letting developers use the same system if they want things to work on iOS, lock…

Call it Intelligence Store and charge… wait for it… 30%.

Re: Apple Foundation Models

#20

Post by _pdp_ »

From app developer standpoint why would anyone ship claude keys like that ... or am I missing something? From consumer standpoint - I guess they can use their own keys but it is not something that is very user friendly as you can imagine.
Post reply on HN