Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

9to5mac.com

Post reply on HN
Print view View original

61–70 of 73 posts

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#61

Post by mritchie712 »

dannyw wrote: post #6
MisterBiggs wrote: post #5

I have a hard time believing this since everything Apple has been releasing in the AI space points towards running models locally.

Few thoughts here: 1. You can't fit a XXX billion param model on an iPhone. It's just impossible. A mixed approach where most ML is local; but some are cloud, fits with their existing Siri approach. 2. OpenAI won't share model weights, but if there's one company they'd make an exception for, it'd be Apple. Certainly not their big models, but perhaps they have a distilled, SOTA 3-7B model that they're happy to license…

> OpenAI won't share model weights

Microsoft has 'em [0]

0 - plenty of sources on this, but here's one https://x.com/elonmusk/status/1639138603371491329

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#62

Post by mritchie712 »

zer00eyz wrote: post #2

> A report on Thursday emphasized that iOS 18’s AI features will be powered (in part) by Apple data centers with Apple Silicon processors. The majority of iOS 18’s AI features, however, will be powered entirely on-device, allowing Apple to tout privacy and speed benefits. I wonder if this is the gpt2 we saw recently: https://news.ycombinator.com/item?id=40201486

Many models are already smart enough for so many interesting use cases, but they're too slow to build compelling experiences.

What we (speaking selfishly about https://www.definite.app/) really need are faster models.

I really hope the rumors are true about gpt2 and it's a smaller, faster, gpt4ish level of intelligence model.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#63

Post by lolinder »

MisterBiggs wrote: post #11
dannyw wrote: post #6

Earlier quoted context omitted.

Few thoughts here: 1. You can't fit a XXX billion param model on an iPhone. It's just impossible. A mixed approach where most ML is local; but some are cloud, fits with their existing Siri approach. 2. OpenAI won't share model weights, but if there's one company they'd make an exception for, it'd be Apple. Certainly not their big models, but perhaps they have a distilled, SOTA 3-7B model that they're happy to license…

For 1. Apple is certainly trying to fit models onto an iPhone with OpenELM and I think the M4 debuting on an iPad is also posturing for local compute as well. A mixed approach is a great point though and I think I could mostly be happy with that.

> For 1. Apple is certainly trying to fit models onto an iPhone with OpenELM and I think the M4 debuting on an iPad is also posturing for local compute as well.

You misunderstand point 1. Three-digit billion parameter models like GPT-4 (or even 3.5) aren't going to fit on modern iPhones, not even close. Even Llama 70b requires 35GB of RAM at q4 quantization, and that's just for the model.

Compare that to the iPhone 15's 6GB and you'll see the problem. Apple isn't about to announce an iPhone with 6x as much RAM as any previous model. I'd be shocked if they even doubled it. Their local inference models are going to be tiny and limited, which is fine, but that means they have to go to the cloud to provide all the features people are expecting.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#65

Post by gnicholas »

MisterBiggs wrote: post #5

I have a hard time believing this since everything Apple has been releasing in the AI space points towards running models locally.

It would be really great if they could respond immediately using locally-generated information, and then seamlessly weave in data that comes back from the cloud.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#66

Post by ThisIsAWhatWhat »

ghaff wrote: post #34
ThisIsAWhatWhat wrote: post #29

Earlier quoted context omitted.

I'm still using my original SE, and I have Siri turned off. I don't remember it being a hassle. I'd prefer that Apple stop removing valuable functionality and replacing it with junk. The removal of the headphone jack and Touch ID have deterred me from buying a new iPhone. I'm writing an mobile app right now, and I'm targeting iOS 15 so I can run it on my own phone. This requires some non-trivial workarounds to insuff…

Missed calls are junk more often than not. They fall into the vast category of things I don’t want notifications for.

What a crock. You can silence unknown numbers. Not to mention that nobody said you'd be forced to use this feature.

If an emergency happens with my parents, they're going to CALL ME. And the fact that I won't know about it if I happen to be in the shower or down the hall doing laundry or working outside for a few minutes is absurd and stupid.

Unbelievable that anyone would argue against this obvious OPTIONAL function, which has been present on telephonic devices for decades. Apple's handheld Unix computer/phone is the first I've had without it... and the one with the least excuse.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#67

Post by ThisIsAWhatWhat »

illiac786 wrote: post #55
ghaff wrote: post #54

Earlier quoted context omitted.

If it’s important they’ll leave a voicemail that I’ll notice sooner or later—as I will that there was a missed call. If it’s a number I don’t recognize and there’s no voicemail I’ll assume it was junk. I just have very few notifications turned on. For example none of my chat programs notify.

It was never the statement the number is unknown though. You’re talking about your case and you’re applying it to everyone. Some people want more notifications, need more, some don’t (you). I perfectly understand that a missed call can be critical. Some callers are not very bright and don’t understand that if it’s critical they should leave a voicemail or send a message. I deal with such people a lot.

Exactly, but even a voicemail isn't enough if the phone doesn't produce a repeating audible notification that you received one.

Sad that we have to explain this to people.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#70

Post by shepherdjerred »

Tagbert wrote: post #12

It looks like Apple will have a modular approach to AI. With some third-party components and some their own. They have and will double down on AI within apps, like selecting the subject in photos, transformer driven typing suggestions, and other app features. They will have a way to call out to a third-party, server-side GPT-style AI like ChatGPT for some functions. They will have one more more local AIs running on-d…

I feel like this is the obvious play considering they've been building AI features into their chips for _years_ and under utilizing the hardware. If Apple could combine ChatGPT + Siri they'd have the best voice assistant.
Post reply on HN