181–190 of 343 posts
Microsoft owns 49 percent of OpenAI. That must be some really detailed 100+ pages contract. I bet Microsoft is mentioned multiple times with things to the effect of: "Under no condition is Microsoft allowed to access any of the data coming from iPhones."
I was surprised how little they are leaning on OpenAI. Most of the impressive integrations that actually look useful are on-device or in their private cloud. OpenAIs ChatGPT was relegated to a corner of Siri for answering "google queries", if you grant it permission. This seems like an L for OpenAI, not being a bigger part of the architecture (and I'm glad).
So does this mean that by default, a random Apple user won't have their ChatGPT requests used for OpenAI training, but a paying ChatGPT Plus customer will?
Does this also mean that if I connect my ChatGPT Plus account that my data will be used for training?
It just seems strange to have a lower bar for privacy for paying customers vs users acquired via a partnership.
(yes I'm aware that the "Temporary Chat" feature or turning off memory will prevent data being used for training)
Earlier quoted context omitted.
> They are the first ones to ship on-device inference at scale on non-nvidia hardware Which is neat, but it's not CUDA. It's an application-specific accelerator good at a small subset of operations, controlled by a high-level library the industry is unfamiliar with and too underpowered to run LLMs or image generators. The NPU is a novelty, and today's presentation more-or-less confirmed how useless it is for rich loc…
Bit of a detail, but where are you deriving “with hundreds of terabytes of unified GPU memory” from?
But the point stands, these systems occupy a niche that Apple Silicon is poorly suited to filling. They run normal Linux, they support common APIs, and network to dozens of other machines using Infiniband.
Earlier quoted context omitted.
They did talk about Siri being better at voice recognition using Apple's own on-device models, so I imagine that will eventually apply more broadly.
On-device models will not be big enough in the near future. What makes ChatGPT so awesome at recognition is that their model is huge, and so no matter how obscure the topic of the dictation, ChatGPT knows what you're talking about.
Plus, they talk about live phone call transcriptions, voice transcription in notes, the ability to correct words as you speak, contextual conversations in siri, etc. It 100% sounds like better voice recognition is coming
My biggest disappointment was that Apple said nothing about leveraging GPT-4 to improve voice recognition in iMessage. Voice recognition of ChatGPT is incredibly accurate when compared to iOS. ChatGPT almost never gets anything wrong, while iMessage/iOS voice recognition is extremely frustrating. So much so that I sometimes dictate to ChatGPT then cut & paste into iMessage.
Earlier quoted context omitted.
I think the headlines are REALLY muddying things. From watching the Keynote, most of Apple Intelligence is their own stuff, mostly on-device. Siri explicitly asks you if you want to use chatGPT to answer a query. It does so when it thinks chatGPT will have a better answer. It sounds like that will be for very creative/generative types of things like "please create a 4 course meal with xyz foods," at which point Siri…
That said, the Apple Intelligence vs. OpenAI distinction seems much clearer than the Apple cloud vs. local distinction, which I find somewhat concerning. Sure, the Apple cloud is ultra-secure and private and all, but I'd still like to know what happens where without having to test it myself by enabling airplane mode and seeing what still works.
Earlier quoted context omitted.
They did talk about Siri being better at voice recognition using Apple's own on-device models, so I imagine that will eventually apply more broadly.
On-device models will not be big enough in the near future. What makes ChatGPT so awesome at recognition is that their model is huge, and so no matter how obscure the topic of the dictation, ChatGPT knows what you're talking about.
Earlier quoted context omitted.
> Apple also has the means to build data center training hardware using apple silicon if they want to do so. > If they are serious about the OAI partnership they could also start to supply them with cloud inference hardware and strongarm them into only using apple servers to serve iOS requests Apple addressed both these points in today’s preso. 1. They will send requests that require larger contexts to their own Appl…
I'm pretty sure those points do not apply to ChatGPT integration. ChatGPT is still running on Nvidia.
You’re absolutely right. I got too excited about Apple’s strategy to encourage developers to use Apple Private Cloud Compute.
The UX for ChatGPT as shown for iOS 18 makes it obvious that you are sending data outside the Apple Silicon walled garden.