Live data from Hacker News

OpenAI and Apple Announce Partnership

openai.com

301–310 of 343 posts

Re: OpenAI and Apple Announce Partnership

#301

GPT4o access is a handy feature, but, what I was hoping to hear about is an improvement in Siri's language "understanding." In today's WWDC presentation, there were a few small examples of Siri improvements, such as an ability to maintain context, e.g., 'Add her flight arrival time to my calendar,' wherein Siri knows who "her" refers to. In my day-to-day experience with Siri, it's clear Siri doesn't have the kind of…

I thought from the Apple keynote that Siri is getting a big update to be based on Apple Intelligence, not that this context stuff was getting hacked into the existing Siri model. They talked about new voice transcription features, the ability to correct yourself while talking, deep knowledge of your personal context, etc.

It sounds like a bigger update, where they’re applying gen AI models more broadly across tons of things (including I things like photo categorization), but I guess we’ll see.

Re: OpenAI and Apple Announce Partnership

#302
post #277

Earlier quoted context omitted.

Anyone claiming that accuracy of AI models WILL improve is either unaware of how they really work or is a snake oil salesman. Forget about a model that knows EVERYTHING. Let's just train a model that only is expert in not all the law of United states just one state and not even that, just understands FULLY the tax law of just one state to the extent that whatever documents you throw at it, it beats a tax consultancy…

Why does a mobile app needs to beat a highly trained professional every single time in order to be useful? Is this standard applied to any other app?

Because it's taxation. Financial well being is at stack. We're even looking at a potential jail time for tax fraud, tax evasion and what not.

My app is powered by GTPChatChat, the model beating all artificially curated benchmarks.

Still wanna buy?

Re: OpenAI and Apple Announce Partnership

#303
post #34

Earlier quoted context omitted.

They're even explicitly saying: > These models run on servers powered by Apple silicon [...] That doesn't mean that there are no Nvidia GPUs in these servers, of course.

They say user data remains in the Secure Enclave at all times, which Nvidia GPUs would not be able to access. I am quite certain that their private cloud inference runs only Apple silicon chips. (The pre-WWDC rumors were that they built custom clusters using M2 Ultras.)

> They say user data remains in the Secure Enclave at all times

No they don't. They say that the Secure Enclave participates in the secure boot chain, and in generating non-exportable keys used for secured transport. It reads to me as though user devices will encrypt requests to the keys held in the Secure Enclave of a subset of PCC nodes. A PCC node that receives the encrypted request will use the Secure Enclave to decrypt the payload. At that point, the general-purpose Application Processor in the PCC node has a cleartext copy of the user request for doing the needful inference, which _could_ be done on an NVidia GPU, but appears to be done on general-purpose Apple Silicon.

There is no suggestion that the user request is processed entirely within the Secure Enclave. The Secure Enclave is a cryptographic coprocessor. It almost certainly doesn't have the grunt to do inference.

Re: OpenAI and Apple Announce Partnership

#304

GPT4o access is a handy feature, but, what I was hoping to hear about is an improvement in Siri's language "understanding." In today's WWDC presentation, there were a few small examples of Siri improvements, such as an ability to maintain context, e.g., 'Add her flight arrival time to my calendar,' wherein Siri knows who "her" refers to. In my day-to-day experience with Siri, it's clear Siri doesn't have the kind of…

It's worth noting that Apple has been claiming to be able to do this for quite some time. At this point I'm not particularly inclined to believe them.

Re: OpenAI and Apple Announce Partnership

#305

~~This is not the direction I was hoping Apple would go with AI. With all the neural this and that bits baked into apple silicon, it has seemed [0] for a while that Apple wanted to run all these workloads locally, but this partnership seems like a significant privacy backslide. Another comment in this thread said something about they’re using b Apple silicon for these workloads, but didn’t give an indication of wheth…

Watch the keynote, it's all clearly explained and you don't need to learn about it from HN comments.

As I'm sure you're aware people who read Hacker News comments are generally unlikely to watch a hour+ keynote.

Re: OpenAI and Apple Announce Partnership

#307

IMO this really feels like the Facebook / Twitter integration from early iOS. That only lasted a few years. Apple clearly thinks it needs a dedicated LLM service atm. But still thinks it is only supplemental as they handle a bunch of the core stuff without it. And require explicit user consent to use OpenAI. And Apple clearly views it as a partial commodity since they even said they plan to add others. Tough to bet a…

Doubt that Apple can ever come up with a better LLM than OpenAI's, they stopped trying to make Siri as good as Google Assistant after 10+ years now. I don't think they are that good at Cloud or ML compared to other big techs

Re: OpenAI and Apple Announce Partnership

#309

Earlier quoted context omitted.

I look at it from a perspective of interchangeability - if you swapped Steve Ballmer in for Cook, nothing much would have changed. Same if you swapped Nadella in for Pichai, or Pichai for Cook. Very few of these men are exceptional; they are ordinary men with exceptional resources at hand. What they can do, what they should do, and what they can get away with, unseen, govern their impact. Leaders that actually impact…

> They're different types of leaders for different phases of the megacorp organism, and it's OK that Cook isn't Jobs 2.0 - that level of wildness and unpredictability that makes those types of leaders their fortunes can also result in the downfall of their companies. This is absolutely true. But that doesn’t imply that Tim Cook is so unexceptional that anyone with a 120 IQ could do the same job he does. The fact that…

Jobs was growth stocks, Cook is fixed income. Each has their place, and there are good and bad versions of each.

Re: OpenAI and Apple Announce Partnership

#310

Earlier quoted context omitted.

The partnership is structured so that Apple can legally defend including language in their marketing that says things like "users’ IP addresses are obscured." These corporations have proven time and time again that we need to read these statements with the worst possible interpretation. For example, when they say "requests are not stored by OpenAI," I have to wonder how they define "requests," and whether a request n…

Requests are not stored by openai, but stored by Apple and available on request. Is how I interpret that. It's similar to that OneDrive language which was basically allowing user directed privacy invasion. Inevitably,openai will consume and regurgitate all data it touches. It is not clean and anyone thinking openai won't brutalize your data for it's race to general AI is delusional in one of several ways.

I’m not sure I understand the paranoia that Apple is secretly storing your data. Sure they could secretly do so but it doesn’t make any sense. Their whole schtick is privacy. What would Apple benefit from violating what is essentially their core value prop? They’d be one whistleblower away from permanent and irreparable loss of image.
Post reply on HN