Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI and Apple Announce Partnership

openai.com

Post reply on HN
Print view View original

91–100 of 343 posts

Re: OpenAI and Apple Announce Partnership

#91

Post by noahtallen »

philsnow wrote: post #75

~~This is not the direction I was hoping Apple would go with AI. With all the neural this and that bits baked into apple silicon, it has seemed [0] for a while that Apple wanted to run all these workloads locally, but this partnership seems like a significant privacy backslide. Another comment in this thread said something about they’re using b Apple silicon for these workloads, but didn’t give an indication of wheth…

I don't think this is a fair take. It sounds like the vast majority of the new AI features (including the local personal context for Siri, the various text/image editing features, better photo categorization, and the list goes on) are all local, on-device models, which can, if needed, use Apple's private cloud. That requires public researcher verification of server software for iOS to even talk to it. (Allegedly :))

The OpenAI partnership is seemingly only if Siri decides it doesn't have the full context needed to answer. (E.g. if you ask something very creative/generative.) At that point, Siri says "hey, chatGPT might be better at answering this, do you consent to me sending your prompt to them?" and then you get to choose. Apple's partnership also seems to include the various settings that prevent OpenAI from tracking/training on the prompts sent in.

Honestly, that more creative side of genAI is not as interesting in the full context of Apple Intelligence. The real power is coming from the local, personal context, where Siri can deduce context based on your emails, messages, calendar events, maps, photos, etc. to really deeply integrate with apps. (Allegedly!) And that part is not OpenAI.

Re: OpenAI and Apple Announce Partnership

#92

Post by noahtallen »

breadwinner wrote: post #68

My biggest disappointment was that Apple said nothing about leveraging GPT-4 to improve voice recognition in iMessage. Voice recognition of ChatGPT is incredibly accurate when compared to iOS. ChatGPT almost never gets anything wrong, while iMessage/iOS voice recognition is extremely frustrating. So much so that I sometimes dictate to ChatGPT then cut & paste into iMessage.

They did talk about Siri being better at voice recognition using Apple's own on-device models, so I imagine that will eventually apply more broadly.

Re: OpenAI and Apple Announce Partnership

#93

Post by Workaccount2 »

philsnow wrote: post #75

~~This is not the direction I was hoping Apple would go with AI. With all the neural this and that bits baked into apple silicon, it has seemed [0] for a while that Apple wanted to run all these workloads locally, but this partnership seems like a significant privacy backslide. Another comment in this thread said something about they’re using b Apple silicon for these workloads, but didn’t give an indication of wheth…

Apple is in the position where it caters primarily to the tech ignorant, so coming out an explaining that Apple LLM is a bit worse (read: far worse) than the cool LLM's on the internet because they are privacy conscious is a non-starter.

Local LLM's on regular local hardware (i.e. no $500+ dedicated GPUs) is way far behind SoTA models right now.

Apple is not gonna be in a position where you can practically real-time intelligently chat with Android phones while iPhones are churning out 3 tokens/second of near useless babbling.

Re: OpenAI and Apple Announce Partnership

#94

Post by nextworddev »

lanza wrote: post #27
blueelephanttea wrote: post #24

IMO this really feels like the Facebook / Twitter integration from early iOS. That only lasted a few years. Apple clearly thinks it needs a dedicated LLM service atm. But still thinks it is only supplemental as they handle a bunch of the core stuff without it. And require explicit user consent to use OpenAI. And Apple clearly views it as a partial commodity since they even said they plan to add others. Tough to bet a…

Ditto. They'll use it now while they stand to benefit and in 3 years they'll be lambasting OpenAI publicly for not being private enough with data and pretend that they never had anything to do with them.

This partnership is structured so that no data is logged or sent to OpenAI.

Re: OpenAI and Apple Announce Partnership

#95

Post by MR4D »

dereg wrote: post #7
talldayo wrote: post #2

> The ChatGPT integration, powered by GPT-4o , will come to iOS, iPadOS, and macOS later this year. Jensen Huang must be having the time of his life right now. Nvidia's relationship with Apple went from pariah to prodigal son, real fast.

If we know anything about Apple, they're going after Nvidia. If anyone can pull it off, it's going to be them.

Why do you think that?

You seem to be positioning this as a Ford vs Chevy duel, when (to me at least) the comparison should be to Ford vs Exxon.

Nvidia is an infrastructure company. And a darned good one. Apple is a user facing company and has outsourced infrastructure for decades (AWS & Azure being two of the well known ones).

Re: OpenAI and Apple Announce Partnership

#96

Post by beoberha »

hehdhdjehehegwv wrote: post #31
blueelephanttea wrote: post #24

IMO this really feels like the Facebook / Twitter integration from early iOS. That only lasted a few years. Apple clearly thinks it needs a dedicated LLM service atm. But still thinks it is only supplemental as they handle a bunch of the core stuff without it. And require explicit user consent to use OpenAI. And Apple clearly views it as a partial commodity since they even said they plan to add others. Tough to bet a…

There’s a lot I don’t like about Sam Altman. There’s a lot I don’t like about OpenAI. But goddamn they absolutely leapfrogged Google and Apple and it’s completely amazing to see these trillion dollar companies play catch-up with a start-up. I want to see more of this. Big Tech has been holding back innovation for too long.

Big Tech is the only reason OpenAI can run. Microsoft is propping them up with billions of dollars worth of compute and infrastructure

Re: OpenAI and Apple Announce Partnership

#97

Post by dereg »

whimsicalism wrote: post #56
dereg wrote: post #41

Earlier quoted context omitted.

Nvidia obviously has an enormous, enormous moat but I do think this is one of the areas in which Apple may actually GAF. The rollout of Apple Intelligence is going to make them the biggest provider of "edge" inference on day one. They're not going to be able to ride on optimism in services growth forever.

Apple simply does not have the talent pool to take on either nvidia or the big LLM providers anywhere on the stack except for edge inference. If you're saying Apple is going to 'take on nvidia' in edge inference, then I don't disagree but I would hardly even count that as taking on nvidia.

I can't really dispute any of that.

It took almost a decade but the PA Semi acquisition showed that Apple was able to get out of the shadow of its PowerPC era.

Nvidia will remain a leader in this space for a long time. But things are going to play out wonky and Apple, when determined, are actually pretty good at executing on longer-term roadmaps.

Re: OpenAI and Apple Announce Partnership

#98

Post by nextworddev »

eddieplan9 wrote: post #80
MangoCoffee wrote: post #71

Earlier quoted context omitted.

It's a win for OpenAI and AI. I remember someone on Hacker News commented that OpenAI is a company searching for a market. This move might prove that AI, and OpenAI, has a legitimate way to be used and profitable. We'll see.

Steve Jobs famously said Dropbox is a feature not a product. This feels very much like it.

Well, Dropbox is a sub $8bn company now that hasn't really grown in 5 years, so maybe Steve was right?

Re: OpenAI and Apple Announce Partnership

#99

Post by airstrike »

bee_rider wrote: post #70
wg0 wrote: post #52

Earlier quoted context omitted.

Actually, just in three to five years, lots of "AI boxes" and those magical sparkling icons next to input fields summoning AI would be silently removed. LLMs are not accurate, they aren't subject matter experts that'll be maybe within 5% error margin. People will gradually learn and discover anf the cost of keeping a model updated and running won't drastically reduce so we'll most likely see dust settling down.

How do you define a percent error margin on the typical output of something like ChatGPT? IIRC the image generation folks have started using metrics like subjective users ratings because this stuff is really difficult to quantify objectively.

IMHO the terribly overlooked issue with generative AI is that the end users' views of the response generated by the LLM often differs greatly from the opinion of the person actually interacting with the model

this is particularly evident with image generation, but I think it's true across the board. for example, you may think something I created on midjourney "looks amazing", whereas I may dislike it because it's so far from what I had in mind and was actually trying to accomplish when I was sending in my prompt

Post reply on HN