Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

9to5mac.com

Post reply on HN
Print view View original

51–60 of 73 posts

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#51

Post by choppaface »

Tagbert wrote: post #12

It looks like Apple will have a modular approach to AI. With some third-party components and some their own. They have and will double down on AI within apps, like selecting the subject in photos, transformer driven typing suggestions, and other app features. They will have a way to call out to a third-party, server-side GPT-style AI like ChatGPT for some functions. They will have one more more local AIs running on-d…

I like this prediction. Apple Maps version 1 was a huge flop and Siri’s capabilities have been quite conservative despite their investment, and despite Apple getting caught recording users to try to improve it.

It makes a lot of sense for Apple to deploy hardware and small on-device LLMs as extremely overpowered “routing” modules that do basic things locally and then farm out other things to a cloud partner.

This also fits in well with OpenAI allegedly launching some sort of assistant Monday, so then Apple can point to it if it does well (and integrate it) or at the last minute fall back to Google if OpenAI flops.

I wonder if Tim Apple models the Google search deal ending in the next 2-3years, and if there’s a contingency in case chat-based interfaces flop. Given how the car got canned, it would be surprising to see Apple try to make their own GPT-5 / search engine, so the 5-7 year plan must be to remain largely dependent on Google and Microsoft (and to keep Facebook out of the party).

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#52

Post by asadotzler »

anonylizard wrote: post #20
DeathArrow wrote: post #19

Why aren't they using open source models like Llama3?

Like have you checked the license of Llama3? Who told you it was free for all commercial use? Most open source licenses by big companies these days, are anti-big-tech. Aka anyone can use them but big tech. "If, on the Meta Llama 3 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in t…

Those are NOT open source licenses. Stop calling them that and we'll have fewer people like the op confused.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#53

Post by ein0p »

MisterBiggs wrote: post #5

I have a hard time believing this since everything Apple has been releasing in the AI space points towards running models locally.

Por que no los dos? A large LLM won’t fit, but you don’t need a large LLM to invoke functions or answer texts. And when you need chat or search, that can go to the server, same as Siri does today.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#54

Post by ghaff »

illiac786 wrote: post #50
ghaff wrote: post #34

Earlier quoted context omitted.

Missed calls are junk more often than not. They fall into the vast category of things I don’t want notifications for.

I don’t understand the logic. Let’s say a call is not spam, for example, family. You are saying you never miss such a call? You never ever leave your phone or are in a situation where you can’t pick up?

If it’s important they’ll leave a voicemail that I’ll notice sooner or later—as I will that there was a missed call. If it’s a number I don’t recognize and there’s no voicemail I’ll assume it was junk.

I just have very few notifications turned on. For example none of my chat programs notify.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#55

Post by illiac786 »

ghaff wrote: post #54
illiac786 wrote: post #50

Earlier quoted context omitted.

I don’t understand the logic. Let’s say a call is not spam, for example, family. You are saying you never miss such a call? You never ever leave your phone or are in a situation where you can’t pick up?

If it’s important they’ll leave a voicemail that I’ll notice sooner or later—as I will that there was a missed call. If it’s a number I don’t recognize and there’s no voicemail I’ll assume it was junk. I just have very few notifications turned on. For example none of my chat programs notify.

It was never the statement the number is unknown though.

You’re talking about your case and you’re applying it to everyone. Some people want more notifications, need more, some don’t (you).

I perfectly understand that a missed call can be critical. Some callers are not very bright and don’t understand that if it’s critical they should leave a voicemail or send a message. I deal with such people a lot.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#56

Post by ffgjgf1 »

MisterBiggs wrote: post #11
dannyw wrote: post #6

Earlier quoted context omitted.

Few thoughts here: 1. You can't fit a XXX billion param model on an iPhone. It's just impossible. A mixed approach where most ML is local; but some are cloud, fits with their existing Siri approach. 2. OpenAI won't share model weights, but if there's one company they'd make an exception for, it'd be Apple. Certainly not their big models, but perhaps they have a distilled, SOTA 3-7B model that they're happy to license…

For 1. Apple is certainly trying to fit models onto an iPhone with OpenELM and I think the M4 debuting on an iPad is also posturing for local compute as well. A mixed approach is a great point though and I think I could mostly be happy with that.

> M4 debuting on an iPad is also posturing for local compute as well.

Wouldn’t memory be a much bigger bottleneck? You don’t really need a particularly fast a CPU/GPU to run most basic models that couldn’t even fit into the amount of memory that Apple is offering on their devices (especially if you still want to run other apps).

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#57

Post by ffgjgf1 »

a_wild_dandan wrote: post #45
dannyw wrote: post #6

Earlier quoted context omitted.

Few thoughts here: 1. You can't fit a XXX billion param model on an iPhone. It's just impossible. A mixed approach where most ML is local; but some are cloud, fits with their existing Siri approach. 2. OpenAI won't share model weights, but if there's one company they'd make an exception for, it'd be Apple. Certainly not their big models, but perhaps they have a distilled, SOTA 3-7B model that they're happy to license…

You can fit a Q5 Llama-3-8b or many other models on new iPhones.

It’s not very good though and with 6 GB of memory iPhones would struggle anything else alongside it so forget multitasking or even running the full OS while it’s loaded..

Almost all Apple devices (including most Macs) have very low amounts of memory so Apple hadn’t really positioned themselves that well if their goal is running LLMs locally.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#58

Post by ffgjgf1 »

dareal wrote: post #47
dannyw wrote: post #6

Earlier quoted context omitted.

Few thoughts here: 1. You can't fit a XXX billion param model on an iPhone. It's just impossible. A mixed approach where most ML is local; but some are cloud, fits with their existing Siri approach. 2. OpenAI won't share model weights, but if there's one company they'd make an exception for, it'd be Apple. Certainly not their big models, but perhaps they have a distilled, SOTA 3-7B model that they're happy to license…

Gemini nano is already in Google pixel and runs locally.

Pixels have a lot more RAM than iPhones though, only low-end Androids devices have as little.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#59

Post by d13 »

ffgjgf1 wrote: post #57
a_wild_dandan wrote: post #45

Earlier quoted context omitted.

You can fit a Q5 Llama-3-8b or many other models on new iPhones.

It’s not very good though and with 6 GB of memory iPhones would struggle anything else alongside it so forget multitasking or even running the full OS while it’s loaded.. Almost all Apple devices (including most Macs) have very low amounts of memory so Apple hadn’t really positioned themselves that well if their goal is running LLMs locally.

Llama 3 8b Q5 is within GPT4 territory. I’ve been using it daily, it’s astonishing.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#60

Post by ffgjgf1 »

d13 wrote: post #59
ffgjgf1 wrote: post #57

Earlier quoted context omitted.

It’s not very good though and with 6 GB of memory iPhones would struggle anything else alongside it so forget multitasking or even running the full OS while it’s loaded.. Almost all Apple devices (including most Macs) have very low amounts of memory so Apple hadn’t really positioned themselves that well if their goal is running LLMs locally.

Llama 3 8b Q5 is within GPT4 territory. I’ve been using it daily, it’s astonishing.

I found it to be not even remotely close outside of a few tasks/queries
Post reply on HN