Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

9to5mac.com

Post reply on HN
Print view View original

41–50 of 73 posts

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#41

Post by jwells89 »

Xenoamorphous wrote: post #31
MisterBiggs wrote: post #5

I have a hard time believing this since everything Apple has been releasing in the AI space points towards running models locally.

I see a lot of talk in HN about how Apple running models on the device is such a great idea, for privacy reasons. However I feel like outside of a few niches like HN, people don’t give a damn about privacy (for example, the company I work for has a website with millions of daily unique visitors; GDPR consent rates are usually around 98%). So if other phones use models running on the cloud and they’re higher quality t…

A big differentiator is that local models have access to more user data without sending anything over the wire (which ignoring privacy implications, isn’t free).

Local models can also more easily plug into existing macOS/iOS facilities like AppleScript, Automator, Services, Shortcuts, and NSUserActivity which means they’ll be a lot more functional, with the ability to wire together apps that haven’t explicitly added AI support.

In other words there’s a lot of potential here. If implemented well, LLM-powered Siri would have vastly more context and integration than anything else right out of the gate.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#42

Post by wiseowise »

tropicalbeach wrote: post #38
bamboozled wrote: post #28

Earlier quoted context omitted.

I immediately thought the same, I don’t want it. I personally don’t find ChatGPT very useful. Let’s just hope it’s opt out.

People like this live in the stone age

>> I don’t want to use half-baked, heavily censored, hallucinating piece of crap that will affect battery life of my device

> you’re living in the Stone Age, lolz

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#43

Post by weikju »

tropicalbeach wrote: post #38
bamboozled wrote: post #28

Earlier quoted context omitted.

I immediately thought the same, I don’t want it. I personally don’t find ChatGPT very useful. Let’s just hope it’s opt out.

People like this live in the stone age

Your comment isn’t helpful to have a good and useful conversation about this. There are multiple viewpoints and levels of acceptance of new technology.

Skepticism is healthy and even warranted. We don’t have to gleefully embrace every new shiny thing the tech companies throw at us.

Heck the founder of this site himself once wrote an essay cautioning about adopting new services or tech too quickly because it is too often turned against us [1]:

> It took a while though—on the order of 100 years. And unless the rate at which social antibodies evolve can increase to match the accelerating rate at which technological progress throws off new addictions, we'll be increasingly unable to rely on customs to protect us. [3] Unless we want to be canaries in the coal mine of each new addiction—the people whose sad example becomes a lesson to future generations—we'll have to figure out for ourselves what to avoid and how. It will actually become a reasonable strategy (or a more reasonable strategy) to suspect everything new.

[1] https://paulgraham.com/addiction.html

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#44

Post by ghaff »

hackernewds wrote: post #36
bamboozled wrote: post #28

Earlier quoted context omitted.

I immediately thought the same, I don’t want it. I personally don’t find ChatGPT very useful. Let’s just hope it’s opt out.

Curious why not?

Not the parent but I just don’t. I have used it to basically help with some largely boilerplate writing—as in get a pre-draft down on a page and adapt it from there.

Don’t do a lot of programming any longer.

It’s sometimes useful but at this point it just isn’t revolutionary for anything I do.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#45

Post by a_wild_dandan »

dannyw wrote: post #6
MisterBiggs wrote: post #5

I have a hard time believing this since everything Apple has been releasing in the AI space points towards running models locally.

Few thoughts here: 1. You can't fit a XXX billion param model on an iPhone. It's just impossible. A mixed approach where most ML is local; but some are cloud, fits with their existing Siri approach. 2. OpenAI won't share model weights, but if there's one company they'd make an exception for, it'd be Apple. Certainly not their big models, but perhaps they have a distilled, SOTA 3-7B model that they're happy to license…

You can fit a Q5 Llama-3-8b or many other models on new iPhones.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#46

Post by devinprater »

I can't wait to see what accessibility updates they can do with local/remote AI! I'm definitely getting the Pro iPhone this year if it's running a faster CPU or has more RAM for bigger models. And that could be a selling point for the pro phones this year. Get AppleLLM 3B on a 6 GB iPhone, or Apple 7B which can describe images/videos right on device, describe animations in apps, and try to describe what's happening in all those emulated video games, with the 8/12GB iPhone Pro. I know, wild. But Apple's current screen recognition, using image classification ML from like 3 years ago, works a good 1 description per 2 seconds or so. If they can make AI updates that fast, with a buffer to only keep describing changes in the scene/video, I think it'd work well.

On the other hand, isn't it a bit late for Apple to be finalizing things before WWDC? I mean, that doesn't give them that much time to make the video and prepare dev builds. And then they have to tune the system prompt, slide it into the OS (although maybe they have just an API field they can just plug it into), and then do QA. I don't know. Maybe this is old info. Still, I'll be eagerly awaiting any VoiceOver/accessibility updates!

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#47

Post by dareal »

dannyw wrote: post #6
MisterBiggs wrote: post #5

I have a hard time believing this since everything Apple has been releasing in the AI space points towards running models locally.

Few thoughts here: 1. You can't fit a XXX billion param model on an iPhone. It's just impossible. A mixed approach where most ML is local; but some are cloud, fits with their existing Siri approach. 2. OpenAI won't share model weights, but if there's one company they'd make an exception for, it'd be Apple. Certainly not their big models, but perhaps they have a distilled, SOTA 3-7B model that they're happy to license…

Gemini nano is already in Google pixel and runs locally.

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#48

Post by whatindaheck »

Xenoamorphous wrote: post #31
MisterBiggs wrote: post #5

I have a hard time believing this since everything Apple has been releasing in the AI space points towards running models locally.

I see a lot of talk in HN about how Apple running models on the device is such a great idea, for privacy reasons. However I feel like outside of a few niches like HN, people don’t give a damn about privacy (for example, the company I work for has a website with millions of daily unique visitors; GDPR consent rates are usually around 98%). So if other phones use models running on the cloud and they’re higher quality t…

Apple is primarily a hardware company. Privacy claims aside, on-device gives Apple a reason to keep making, improving, and selling hardware.

I also don’t think the GDPR consent is a good measure. Those suck to opt out of manually and I doubt most people consider finding an extension. Apple sells its privacy as zero to low configuration. You “buy” privacy, you don’t configure it. Whether their claims are misleading or not. That’s extremely appealing.

A few other thoughts:

* Local models would be a requirement if Advanced Data Protection[0] were enabled

* Local models could potentially do some interesting work with hefty data (something media related maybe) that isn’t fit for cloud workflows

[0]: https://support.apple.com/guide/security/advanced-data-prote...

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#49

Post by sillywalk »

MisterBiggs wrote: post #5

I have a hard time believing this since everything Apple has been releasing in the AI space points towards running models locally.

It looks like both, and they're apparently using Apple Silicon in their own datacenters. From Bloomberg[0] (archived)[1]:

"Apple Inc. will deliver some of its upcoming artificial intelligence features this year via data centers equipped with its own in-house processors, part of a sweeping effort to infuse its devices with AI capabilities.

The company is placing high-end chips — similar to ones it designed for the Mac — in cloud-computing servers designed to process the most advanced AI tasks coming to Apple devices, according to people familiar with the matter. Simpler AI-related features will be processed directly on iPhones, iPads and Macs

...

The first AI server chips will be the M2 Ultra, which was launched last year as part of the Mac Pro and Mac Studio computers, though the company is already eyeing future versions based on the M4 chip..."

...

Relatively simple AI tasks — like providing users a summary of their missed iPhone notifications or incoming text messages — could be handled by the chips inside of Apple devices. More complicated jobs, such as generating images or summarizing lengthy news articles and creating long-form responses in emails, would likely require the cloud-based approach — as would an upgraded version of Apple’s Siri voice assistant.

...

For now, Apple is planning to use its own data centers to operate the cloud features, but it will eventually rely on outside facilities — as it does with iCloud and other services. The Wall Street Journal reported earlier on some aspects of the server plan."

---

And from [2], Apple has been working on Apple Chips in Data Center (ACDC) for few years, focusing on AI inference, not training.

[0] https://www.bloomberg.com/news/articles/2024-05-09/apple-to-...

[1] https://archive.ph/MUswk

[2] https://www.medianama.com/2024/05/223-apple-launches-project...

Re: Apple finalizing deal with OpenAI to bring ChatGPT features to iOS 18

#50

Post by illiac786 »

ghaff wrote: post #34
ThisIsAWhatWhat wrote: post #29

Earlier quoted context omitted.

I'm still using my original SE, and I have Siri turned off. I don't remember it being a hassle. I'd prefer that Apple stop removing valuable functionality and replacing it with junk. The removal of the headphone jack and Touch ID have deterred me from buying a new iPhone. I'm writing an mobile app right now, and I'm targeting iOS 15 so I can run it on my own phone. This requires some non-trivial workarounds to insuff…

Missed calls are junk more often than not. They fall into the vast category of things I don’t want notifications for.

I don’t understand the logic. Let’s say a call is not spam, for example, family. You are saying you never miss such a call? You never ever leave your phone or are in a situation where you can’t pick up?
Post reply on HN