Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

9to5mac.com

Post reply on HN
Print view View original

11–20 of 73 posts

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#11

Post by MisterBiggs »

dannyw wrote: post #6
MisterBiggs wrote: post #5

I have a hard time believing this since everything Apple has been releasing in the AI space points towards running models locally.

Few thoughts here: 1. You can't fit a XXX billion param model on an iPhone. It's just impossible. A mixed approach where most ML is local; but some are cloud, fits with their existing Siri approach. 2. OpenAI won't share model weights, but if there's one company they'd make an exception for, it'd be Apple. Certainly not their big models, but perhaps they have a distilled, SOTA 3-7B model that they're happy to license…

For 1. Apple is certainly trying to fit models onto an iPhone with OpenELM and I think the M4 debuting on an iPad is also posturing for local compute as well.

A mixed approach is a great point though and I think I could mostly be happy with that.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#12

Post by Tagbert »

It looks like Apple will have a modular approach to AI. With some third-party components and some their own.

They have and will double down on AI within apps, like selecting the subject in photos, transformer driven typing suggestions, and other app features.

They will have a way to call out to a third-party, server-side GPT-style AI like ChatGPT for some functions.

They will have one more more local AIs running on-device and possibly replacing what Siri does now and tying the other AI together. This would likely intercept the user's request, infer the meaning, and match that to one or more service to satisfy that request. This is probably like what Rabbit R1 wanted to be but didn't have access to the features that Apple AI would.

Apple has been building the components of this for years. Their App Intents interface lets apps publish their features and make them available to call from automation like Shortcuts or an LLM powered Siri. They have been shipping devices with neural processors for 7 years. They have been publishing papers about ways to run LLMs and other AI on device and with reduced resources. If you aren't building a web answerbot yourself, you don't need the full scope of a ChatGPT locally.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#13

Post by Tagbert »

MisterBiggs wrote: post #5

I have a hard time believing this since everything Apple has been releasing in the AI space points towards running models locally.

I suspect that they will be running AI locally but also calling out to server-side services where necessary. I don't expect a ChatGPT integration to be the whole of what Apple has planned for AI on their devices.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#14

Post by Tagbert »

Humphrey wrote: post #8

Due to time constraints, it sounds like this would be a relatively simple integration that operates similar to standard ChatGPT - whereas, the rest of us are all hoping for LLM powered Siri 2.0. On device would be amazing, but I suspect GPT 4.0 would still be too large to be able to run on device - regardless on how much more Neural Engine grunt the next A series Apple chip has.

I think that server-side AI is just one component in a module approach with them running as much as they can on-device and with their own models. Imagine an AI powered Siri that runs on device to handle a lot of the basic interaction and functions and then calls out to the server for more heavy lifting.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#15

Post by kredd »

behnamoh wrote: post #9

The biggest lesson of the last two years is this: There's so much INERTIA in this industry, way more inertia than what most people believed. Let me explain: In the good old GPT-3 era, we already had iOS Shortcuts that could receive voice commands from the user, send it to GPT-3 API, and show/speak the results. I had it on my Apple Watch. It was just one tap away. This made me and many enthusiasts optimistic about rec…

I agree about the jobs, but not about the web part. Any image or blob of text have absolutely lost its meaning. Every comment has an undertone of “is it written by a human?” question surrounding it. It wasn’t really the case 5 years ago, and as it became ubiquitous, even my friends who are not in tech-adjacent fields feel the same way. Benefit of the doubt that one is a human behind a comment has been shifted, so now you have to prove you’re not actually an LLM-bot.

Unfortunately it’s only going to get worse. Just like how digital art has zero significance nowadays (hay-days of 2008 deviantART, when some digital art was considered impressive, is gone), so will a lot of other things. My only hope is, it will boost something else that we don’t know yet, or maybe we’ll go back to prioritizing the reality.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#16

Post by blackeyeblitzar »

It’s a little disappointing that the way most people will experience AI is going to be through just a few companies (Apple, Microsoft, OpenAI). If they all adopt a similar approach to censorship (safety), that creates various problems for society. Not to mention that kind of economic and cultural power should not be in the hands of a few.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#18

Post by surfpel »

behnamoh wrote: post #9

The biggest lesson of the last two years is this: There's so much INERTIA in this industry, way more inertia than what most people believed. Let me explain: In the good old GPT-3 era, we already had iOS Shortcuts that could receive voice commands from the user, send it to GPT-3 API, and show/speak the results. I had it on my Apple Watch. It was just one tap away. This made me and many enthusiasts optimistic about rec…

What you’re missing is that Apple doesn’t build products or services just to offer random new things, like Google or Microsoft do. Offerings have to be refined and fit within their product vision.

I would be surprised if they released a ChatGPT style chat bot. Likely it will just improve the quality of Siri and search, among other things. I wouldn’t be surprised if Siri has already been benefiting from recent developments.

You’re also implying that they’re moving slowly because they’re a lumbering behemoth, but really they’re just being cautious with an immature and potentially volatile technology.

Think about it: GPT-DAN, free flights and cars being offered by ai chat bots… at Apple scale that would be disastrous.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#20

Post by anonylizard »

DeathArrow wrote: post #19

Why aren't they using open source models like Llama3?

Like have you checked the license of Llama3? Who told you it was free for all commercial use? Most open source licenses by big companies these days, are anti-big-tech. Aka anyone can use them but big tech.

"If, on the Meta Llama 3 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under this Agreement unless or until Meta otherwise expressly grants you such rights."

Post reply on HN