Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple reveals new AI architecture built around Google Gemini models

macrumors.com

Post reply on HN
Print view View original

141–150 of 609 posts

Re: Apple reveals new AI architecture built around Google Gemini models

#141

Post by xattt »

al_borland wrote: post #74
luk212 wrote: post #21

Very Apple-ish approach to AI catch up: wrap an external tool in a privacy architecture, embed into the OS and productize the orchestration layer. It will be interesting to see if the Private Cloud Compute + on-device routing can make third-party model capabilities feel like a first-party system without leaking user context to the model provider. If Apple handles the Google-Apple boundary right, this will be an elega…

As someone who doesn't use Android, they showed a lot of integration into the apps, which I think is where the real magic happens, and it's not something I can do with any 3rd party chatbots today (that I'm aware of). I also don't know that I would trust the other 3rd parties with the access required to pull it off.

If anything, having Shortcuts built-in at the OS level was a very long play that’s going to pay off.

Re: Apple reveals new AI architecture built around Google Gemini models

#143

Post by toddmorey »

luk212 wrote: post #21

Very Apple-ish approach to AI catch up: wrap an external tool in a privacy architecture, embed into the OS and productize the orchestration layer. It will be interesting to see if the Private Cloud Compute + on-device routing can make third-party model capabilities feel like a first-party system without leaking user context to the model provider. If Apple handles the Google-Apple boundary right, this will be an elega…

I'm interested in how it feels to use: whether there is any context leaking, as you mentioned, if it introduces latency, and whether there are any pricing implications? I know they weighed a variety of factors, including the smaller models, but cost had to be a big concern, too... I feel like Google is the only provider giving away so much AI inference for free.

This will further blur the picture about when and how consumers / employees are supposed to pay for AI services. For example, they showed consumer rather than coding tasks, but could you select five files and ask Siri to write a Python script or a small app? Will enterprises just disable Siri AI functionality, or will they be able to route it through their own AI auditing and providers?

Re: Apple reveals new AI architecture built around Google Gemini models

#145

Post by djsjajah »

kube-system wrote: post #98
bensyverson wrote: post #2

I would love to learn more about what's actually powering Apple Intelligence now. Are they using flagship Gemini models behind their own prompts? Fine-tuning? Pre-training their own models based on Gemini? Is there a meaningful distinction between the Gemini-powered models and Apple Foundation Models? Does that distinction vary for on-device vs hosted models? Are some models running on Apple's Private Cloud Compute a…

> what's actually powering Apple Intelligence now. It's a 3B Apple Foundation model. https://machinelearning.apple.com/research/introducing-apple... If you've got a mac, you can use this to play around with it: https://apfel.franzai.com/

I think what they mean by “now” is the stuff announced today.

Re: Apple reveals new AI architecture built around Google Gemini models

#146

Post by dd8601fn »

oulipo2 wrote: post #105
potatoman22 wrote: post #35

Earlier quoted context omitted.

I'd wager that for 99.9% of "Apple Intelligence" tasks, Google's models perform just as well as other frontier labs. Google also has done more work on getting LLMs running on edge devices compared to anthropic and openAI. The source also says > The new architecture centers on Apple Foundation Models co-developed with Google, which Apple says are adapted to run both on-device and on servers through its existing Privat…

That's not the point of OP. The point of OP is that Google is a direct competitor of Apple for phones / OS, so them giving the "key of the house" to Google is risky

What indicates they’ve given google anything other than a truckload of cash? There’s zero data sharing in the arrangement and the stuff is running on apple devices and in Apples Private Compute.

Not even Apple has access to it, by design.

Re: Apple reveals new AI architecture built around Google Gemini models

#147

Post by create_accounts »

hectdev wrote: post #92
jamesgill wrote: post #88

Maybe I'm wrong, but this seems to strongly undercut Apple's claims about privacy.

>The company reiterated that Apple Intelligence relies on on-device processing and Private Cloud Compute, with a promise that user data is only used to execute the immediate request and is not accessible to Apple or third parties. Apple added that outside experts can verify those privacy guarantees "at any time."

If you want to independently audit it from the outside, then you might not be an expert for Apple

Re: Apple reveals new AI architecture built around Google Gemini models

#148

Post by bigfudge »

lacker wrote: post #103
microflash wrote: post #3

Not launching in EU feels like a smell. It does look interesting enough for me to try it out before disabling Apple Intelligence again.

It is a smell. But it's the EU that smells bad, when it comes to tech regulation. It's the smell of cookie popup warnings.

Nothing in the law requires the pop up. It definitely doesn’t require the obnoxious bullshit that most companies put up (aka the dark pattern to get you to agree to every unreasonable part of their terms just to read the page).

The alternative would be to just stop invasive tracking and add the cookie when it’s actually needed.

Re: Apple reveals new AI architecture built around Google Gemini models

#149

Post by twothreeone »

dejawu wrote: post #7

It's strange to me that Apple would choose to disadvantage themselves by selecting Google as their provider as opposed to, say, Anthropic or even OpenAI. Doesn't this mean they'll struggle more to differentiate themselves from the assistant on Android phones? Thinking more cynically, couldn't Google, if they wanted, feed Apple an inferior version of Gemini, ensuring they stay ahead? As the consumer, this just sucks b…

Didn't they famously have a search deal with Google (that they were also ultimately fined for - in the EU at least)? So there's definitely precedent with Google as a "partner".
Post reply on HN