Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

9to5mac.com

Post reply on HN
Print view View original

1–10 of 73 posts

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#2

Post by zer00eyz »

> A report on Thursday emphasized that iOS 18’s AI features will be powered (in part) by Apple data centers with Apple Silicon processors. The majority of iOS 18’s AI features, however, will be powered entirely on-device, allowing Apple to tout privacy and speed benefits.

I wonder if this is the gpt2 we saw recently: https://news.ycombinator.com/item?id=40201486

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#6

Post by dannyw »

MisterBiggs wrote: post #5

I have a hard time believing this since everything Apple has been releasing in the AI space points towards running models locally.

Few thoughts here:

1. You can't fit a XXX billion param model on an iPhone. It's just impossible. A mixed approach where most ML is local; but some are cloud, fits with their existing Siri approach.

2. OpenAI won't share model weights, but if there's one company they'd make an exception for, it'd be Apple. Certainly not their big models, but perhaps they have a distilled, SOTA 3-7B model that they're happy to license, especially with Apple's Secure Enclave and ML model encryption.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#7

Post by leobg »

photochemsyn wrote: post #3

I really would like to talk to a completely unconstrained LLM running at the upper end of the current technological limit. Not going to tell you what we would talk about.

You can. Simply use the base models. You can do anything once you ditch the RLHF and the instruction tuning. Then, even those 7b versions are mindblowingly good. But you’ll need to either change your prompting style or do your own fine-tuning to get the behavior you want.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#8

Post by Humphrey »

Due to time constraints, it sounds like this would be a relatively simple integration that operates similar to standard ChatGPT - whereas, the rest of us are all hoping for LLM powered Siri 2.0.

On device would be amazing, but I suspect GPT 4.0 would still be too large to be able to run on device - regardless on how much more Neural Engine grunt the next A series Apple chip has.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#9

Post by behnamoh »

The biggest lesson of the last two years is this: There's so much INERTIA in this industry, way more inertia than what most people believed. Let me explain: In the good old GPT-3 era, we already had iOS Shortcuts that could receive voice commands from the user, send it to GPT-3 API, and show/speak the results. I had it on my Apple Watch. It was just one tap away. This made me and many enthusiasts optimistic about receiving official support of such features on the iPhone and Apple Watch.

Fast forward two years later, and the AI penetration landscape doesn't look good. Apple just started thinking about "doing something" about "this AI thing" (which they don't call AI btw, but that's Apple being Apple). Google has a redundant Gemini app on stock Android which overlaps with Google Assistant capabilities (so Google Assistant is not actually equipped with large LMs yet), Alexa is still the same Alexa, and Microsoft Copilot is half-baked in terms of UI/UX (I still don't know why Microsoft can't build decent user apps).

The lesson is clear: There is so much inertia in this industry that our jobs will be safe for the foreseeable future. Everyone was afraid of AI-generated content polluting the web. Well, here we are, and aside from some ridiculously obvious content which is generated by AI, the web is still the same web we knew in 2022.

It's ridiculous how long ordinary users have to wait for this AI stuff to become officially available on their handheld devices by these companies. Like I said, I and many people were enjoying LLMs on iDevices way before OpenAI introduced ChatGPT and its app companion, and way way before Apple even introduces its own version.

Speaking of Apple's LLM features, do you think they will be bundled with the rest of Apple One service package? Business-wise, it makes sense for Apple to charge people for iLLM/Siri Pro/ or whatever they call it.

Post reply on HN