I was surprised how little they are leaning on OpenAI. Most of the impressive integrations that actually look useful are on-device or in their private cloud. OpenAIs ChatGPT was relegated to a corner of Siri for answering "google queries", if you grant it permission. This seems like an L for OpenAI, not being a bigger part of the architecture (and I'm glad).
OpenAI and Apple Announce Partnership
111–120 of 343 posts
Re: OpenAI and Apple Announce Partnership
#112Earlier quoted context omitted.
To be useful Apple has to share the data with OpenAI
I can only imagine Apple has some kind of siloing agreement with OpenAI, Apple can easily afford whatever price to do so.
Surely Apple wouldn't simply market privacy while lying to their users about who can access their data: https://arstechnica.com/tech-policy/2023/12/apple-admits-to-...
Re: OpenAI and Apple Announce Partnership
#113I just need Apple to be clearly indicating which settings will completely disable this.
I will disable it as soon as it tells me how to also permanently disable live photos.
Re: OpenAI and Apple Announce Partnership
#114this will work about as well as the tedious fad for chatbots a few years ago
Re: OpenAI and Apple Announce Partnership
#115> The ChatGPT integration, powered by GPT-4o , will come to iOS, iPadOS, and macOS later this year. Jensen Huang must be having the time of his life right now. Nvidia's relationship with Apple went from pariah to prodigal son, real fast.
If we know anything about Apple, they're going after Nvidia. If anyone can pull it off, it's going to be them.
Exactly. Apple really needs new growth drivers and Nvidia has a 3bn market cap Apple wants to take a bite out of. One of the few huge tech growth areas that Apple can expand into.
Re: OpenAI and Apple Announce Partnership
#116I still don't know a single person who wants this crap. I don't want "AI" in my web browser, I don't want it in my email client, I don't want it on my phone, I just don't want it. And it feels like everyone I speak to agrees! So who is this all for?
no one wanted an iphone until it came out either
Everyone wanted something like an iphone and when it came it took over the market. We had a product that got shifted into a third world product overnight.
Re: OpenAI and Apple Announce Partnership
#117> The ChatGPT integration, powered by GPT-4o , will come to iOS, iPadOS, and macOS later this year. Jensen Huang must be having the time of his life right now. Nvidia's relationship with Apple went from pariah to prodigal son, real fast.
Eh, it seems from the keynote that ChatGPT will be very selectively used, while most features will be powered by on-device processing and Apple's own private cloud running apple silicon . So all in all, not sure if it's that great for Nvidia.
If OpenAI is furiously buying GPUs to train larger models and Apple is handing OpenAI cash, then this seems like a win for Nvidia. You can argue about how big of a win, but it seems like a positive development.
What would not have been positive for Nvidia is Apple saying they've adapted their HW to server chips and would be partnering with OpenAI to leverage them, but that didn't happen. Apple is busy handing cash back to investors and not seriously pursuing anything but inference.
Re: OpenAI and Apple Announce Partnership
#118Earlier quoted context omitted.
To be useful Apple has to share the data with OpenAI
I can only imagine Apple has some kind of siloing agreement with OpenAI, Apple can easily afford whatever price to do so.
Yes, also covered explicitly in the keynote that Apple user's requests to openAI are not tracked. (Plus you have the explicit opt-in to even access chatGPT via siri in the first place.)
Re: OpenAI and Apple Announce Partnership
#119Earlier quoted context omitted.
Not sure Nvidia is too happy with Apple. They are the first ones to ship on-device inference at scale on non-nvidia hardware. Apple also has the means to build data center training hardware using apple silicon if they want to do so. If they are serious about the OAI partnership they could also start to supply them with cloud inference hardware and strongarm them into only using apple servers to serve iOS requests.
> They are the first ones to ship on-device inference at scale on non-nvidia hardware Which is neat, but it's not CUDA. It's an application-specific accelerator good at a small subset of operations, controlled by a high-level library the industry is unfamiliar with and too underpowered to run LLMs or image generators. The NPU is a novelty, and today's presentation more-or-less confirmed how useless it is for rich loc…
You're approaching this from a developers point of view.
Users absolutely don't care if their prompt response has been generated by a CUDA kernel or some poorly documented apple specific silicon a poor team at cupertino almost lost their sanity to while porting the model.
And haven't they already spent quite a bit on money on their pytorch-like MLX framework?
Re: OpenAI and Apple Announce Partnership
#120~~This is not the direction I was hoping Apple would go with AI. With all the neural this and that bits baked into apple silicon, it has seemed [0] for a while that Apple wanted to run all these workloads locally, but this partnership seems like a significant privacy backslide. Another comment in this thread said something about they’re using b Apple silicon for these workloads, but didn’t give an indication of wheth…
Watch the keynote, it's all clearly explained and you don't need to learn about it from HN comments.
I should have put a disclaimer saying that I hadn’t had a chance to watch the video yet. Thanks for mentioning that it’s addressed, I’ll take a look later.