81–90 of 1001 posts
This seems really cool. They said the models can scale to "private cloud compute" based on Apple Silicon which will be ensured by your device to run "publicly verifiable software" in order to guarantee no misuse of your data. I wonder if their server-side code will be open-source? That'd be positively surprising. Curious to see how this evolves. Anyway, overall looks really really cool. If it works as marketed, then…
This seems really cool. They said the models can scale to "private cloud compute" based on Apple Silicon which will be ensured by your device to run "publicly verifiable software" in order to guarantee no misuse of your data. I wonder if their server-side code will be open-source? That'd be positively surprising. Curious to see how this evolves. Anyway, overall looks really really cool. If it works as marketed, then…
It seems like this is an orchestration layer that runs on Apple Silicon, given that ChatGPT integration looks like an API call from that. It's not clear to me what is being computed on the "private cloud compute"?
- on-device models, which will power any tasks it's able to, including summarisation and conversation with Siri
- private compute models (still controlled by apple), for when it wants to do something bigger, that requires more compute
- external LLM APIs (only chatgpt for now), for when the above decide that it would be better for the given prompt, but always asks the user for confirmation
> ChatGPT will come to iOS 18, iPadOS 18, and macOS Sequoia later this year, powered by GPT-4o.
So is this finally privacy based AI with personal memory included? Ie bespoke AI for your own stack that isn't out in the world.
But I think Apple is going to limit iPhones from doing something like that to boost sales of the 15 Pro and the future gens.