Live data from Hacker News

OpenAI and Apple Announce Partnership

openai.com

131–140 of 343 posts

Re: OpenAI and Apple Announce Partnership

#132
post #105

Earlier quoted context omitted.

This partnership is structured so that no data is logged or sent to OpenAI.

The UI shows a "do you want your data to be sent to OpenAI?" popup.

The parent is partially right, the keynote mentioned that OpenAI agreed to not track Apple user requests.

Re: OpenAI and Apple Announce Partnership

#133
post #52

Earlier quoted context omitted.

Actually, just in three to five years, lots of "AI boxes" and those magical sparkling icons next to input fields summoning AI would be silently removed. LLMs are not accurate, they aren't subject matter experts that'll be maybe within 5% error margin. People will gradually learn and discover anf the cost of keeping a model updated and running won't drastically reduce so we'll most likely see dust settling down.

I truly hope the reckless enthusiasm for LLMs will cool down, but it seems plausible that discretized, compressed versions of today's cutting-edge models will eventually be able to run entirely locally, even on mobile devices; there are no guarantees that they'll get better , but many promising opportunities to get the same unreliable results faster and with less power consumption. Once the models run on-device, ther…

I don't believe this scenario to be very likely because a lot of the 'magic' in current LLMs (emphasis on 'large') is derived from the size of the training datasets and amount of compute they can throw at training and inference.

Re: OpenAI and Apple Announce Partnership

#136

Earlier quoted context omitted.

Not sure Nvidia is too happy with Apple. They are the first ones to ship on-device inference at scale on non-nvidia hardware. Apple also has the means to build data center training hardware using apple silicon if they want to do so. If they are serious about the OAI partnership they could also start to supply them with cloud inference hardware and strongarm them into only using apple servers to serve iOS requests.

> They are the first ones to ship on-device inference at scale on non-nvidia hardware Which is neat, but it's not CUDA. It's an application-specific accelerator good at a small subset of operations, controlled by a high-level library the industry is unfamiliar with and too underpowered to run LLMs or image generators. The NPU is a novelty, and today's presentation more-or-less confirmed how useless it is for rich loc…

Imho, the stronghold of cuda is slowly eroding.

Inference can run without it, and could so for years via ONNX. Now we are starting to see more back-ends becoming available.

see https://github.com/openxla

Re: OpenAI and Apple Announce Partnership

#137
post #2

> The ChatGPT integration, powered by GPT-4o , will come to iOS, iPadOS, and macOS later this year. Jensen Huang must be having the time of his life right now. Nvidia's relationship with Apple went from pariah to prodigal son, real fast.

Not sure Nvidia is too happy with Apple. They are the first ones to ship on-device inference at scale on non-nvidia hardware. Apple also has the means to build data center training hardware using apple silicon if they want to do so. If they are serious about the OAI partnership they could also start to supply them with cloud inference hardware and strongarm them into only using apple servers to serve iOS requests.

I would say MS Copilot+ is shipping on-device inference a few months before Apple, although at 1000x lower volume.

Re: OpenAI and Apple Announce Partnership

#138

Earlier quoted context omitted.

Not sure Nvidia is too happy with Apple. They are the first ones to ship on-device inference at scale on non-nvidia hardware. Apple also has the means to build data center training hardware using apple silicon if they want to do so. If they are serious about the OAI partnership they could also start to supply them with cloud inference hardware and strongarm them into only using apple servers to serve iOS requests.

> They are the first ones to ship on-device inference at scale on non-nvidia hardware Which is neat, but it's not CUDA. It's an application-specific accelerator good at a small subset of operations, controlled by a high-level library the industry is unfamiliar with and too underpowered to run LLMs or image generators. The NPU is a novelty, and today's presentation more-or-less confirmed how useless it is for rich loc…

Bit of a detail, but where are you deriving “with hundreds of terabytes of unified GPU memory” from?

Re: OpenAI and Apple Announce Partnership

#139
post #102

IMO this really feels like the Facebook / Twitter integration from early iOS. That only lasted a few years. Apple clearly thinks it needs a dedicated LLM service atm. But still thinks it is only supplemental as they handle a bunch of the core stuff without it. And require explicit user consent to use OpenAI. And Apple clearly views it as a partial commodity since they even said they plan to add others. Tough to bet a…

Disagree. This feels more like the Google partnership with Apple' Safari that has lasted for long time. Except in this case, I think is OpenAI who will get the big checks.

If Apple wasn't selling privacy, I'd assume the other way around. Or if anything, OpenAI would give the service out for free. There's a reason why ChatGPT became free to the public, GPT-4o moreover. It's obvious that OpenAI needs whatever data it can get its hands on to train GPT-5.

Re: OpenAI and Apple Announce Partnership

#140
post #73
post #26

I still don't know a single person who wants this crap. I don't want "AI" in my web browser, I don't want it in my email client, I don't want it on my phone, I just don't want it. And it feels like everyone I speak to agrees! So who is this all for?

> So who is this all for? It is for everyone and the rest of us. Like it or not. "AI" cannot be stopped.

Cringe
Post reply on HN