So, is Apple running a proprietary LLM or are they licensing one from OpenAI, Google, etc?
Both. Siri is on device and it can talk to ChatGPT
Apple Intelligence for iPhone, iPad, and Mac
21–30 of 1001 posts
Re: Apple Intelligence for iPhone, iPad, and Mac
#22When does this roll out exactly? And exactly which inference actually is on-device? I think people have been fooled by marketing for this one and the new Co-Pilot PCs into thinking that most of the AI really is running on-device. The models that run fast locally are still fairly limited compared to what runs in the cloud.
Usually the OS announced at WWDC is released around mid September.
Re: Apple Intelligence for iPhone, iPad, and Mac
#23This seems really cool. They said the models can scale to "private cloud compute" based on Apple Silicon which will be ensured by your device to run "publicly verifiable software" in order to guarantee no misuse of your data. I wonder if their server-side code will be open-source? That'd be positively surprising. Curious to see how this evolves. Anyway, overall looks really really cool. If it works as marketed, then…
For those curious, there is in fact a ChatGPT integration.
The way it works is that when the on-device model decides "this could better be answered by chatgpt" then it will ask you if it should use that. They described it in a way which seems to indicate that it will be pluggable for other models too over time. Notably, ChatGPT 4o will be available for free without creating an OpenAI account.
Re: Apple Intelligence for iPhone, iPad, and Mac
#24I am pretty unhappy with Apple doing the image generation, was really hoping that just would not happen. But a lot of the other features actually seem useful without feeling shoehorned in. At least so far. I am hoping that I can turn off the ability to use a server while keeping local processing, but curious what that would actually look like. Would it just say "sorry can't do that" or something? Is it that there is…
It was Google who wanted to put glue on pizza, not ChatGPT :)
Re: Apple Intelligence for iPhone, iPad, and Mac
#25"we also intend to add support for other models"
When they pay us sufficiently
It's great that Apple is capitalizing so well on everyone else's inventions, but couldn't they at least pretend they will give something back to the ecosystem?
I wish someone somewhere creates something like intents for the web browser
Re: Apple Intelligence for iPhone, iPad, and Mac
#26This stuff will be well integrated, is useful, will be high quality and doesn't require you to buy new hardware.
Microsoft are so boned. They don't even have a mobile proposition.
Re: Apple Intelligence for iPhone, iPad, and Mac
#27Few thoughts:
It seems like this is what Rabbit's LAM was supposed to be. It is interesting to see it work, and I wonder how it will work in practice. I'm not sold on using voice for interacting with things still.
Image Generation is gross, I really didn't want this. I am not excited to start seeing how many horrible AI images I'm going to get sent.
I like Semantic Search in my photos.
This does seem like the typical Apple polish.I think this might be the first main stream application of Gen AI that I can see catching on.
Re: Apple Intelligence for iPhone, iPad, and Mac
#28My home is filled with Apple HomePods even though Siri is dumb as rocks.
Looking forward to my house gaining a few IQ points.
I don’t see anything that mentions HomePod specifically but hopefully the updates will come.
Re: Apple Intelligence for iPhone, iPad, and Mac
#29Really excited about semantic index. This should allow for google knowledge graph like features grounded in reality for their llm. However it really depends how well it works.
Re: Apple Intelligence for iPhone, iPad, and Mac
#30I really hope we can fully turn off the GPT4o integration even more than just saying no to every escalation