Live data from Hacker News

Apple reveals new AI architecture built around Google Gemini models

macrumors.com

271–280 of 609 posts

Re: Apple reveals new AI architecture built around Google Gemini models

#271
post #245

Earlier quoted context omitted.

Before you start driving, at stop lights, while waiting in lines, etc. I don't know how it works on CarPlay but when I turn my car on I have a bunch of suggested addresses (home, work, parents, recent Maps searches, etc) that I just touch-to-go. Having to use voice every time you want to navigate not only sounds unnecessary, but cumbersome.

Oh so exactly like Apple Maps via Carplay then.

Yep, shouldn't require Siri at all

Re: Apple reveals new AI architecture built around Google Gemini models

#272
post #230

Earlier quoted context omitted.

Apple loves to play dumb about this stuff. The EU imposes a pretty straightforward regulation regarding equality of access. Apple seems to come up with all sorts of "solutions" to this "problem", and each one never amounts to true equality of access. They could easily just allow users to decide "Do you want to give this app unfettered access to all your device data, including other apps' data?". Let users decide. 99%…

> Do you want to give this app unfettered access to all your device data, including other apps' data? Which Facebook and instagram will present as “tee hee updated terms of service” in the first 15 seconds, and people will tick it, because they’re not interested in reading T&C’s, just want to message their friend about dinner, and aren’t suddenly expected be deceived like that.

Obviously there should be a system dialog to grant system permissions. I'm not aware of any kind of system with a capability-based permissions system (e.g. Android, MacOS, browsers, etc.) where apps are allowed to show their own dialog to request permissions. You always have to do something in the system settings to grant permissions.

That's how it should be done. And that would be the responsible way to comply with the DMA.

Re: Apple reveals new AI architecture built around Google Gemini models

#273

Earlier quoted context omitted.

If Apple is running the inference from Apple iPhones and Apple data centers then Apple has operational control. Google’s influence ends the moment they hand the weights over to Apple.

They are using Google Cloud. https://security.apple.com/blog/expanding-pcc/?linkId=100000... "Now, we are collaborating with Google and NVIDIA to run new Apple Intelligence workloads on Google Cloud, extending our industry-leading PCC privacy commitments to third-party data centers for the first time."

That is news — I guess not very surprising that they'd need more data centres than before.

But again there is no Apple-to-Google transfer in the inference in the sense of the comment I was originally replying to (I am not suggesting you're implying otherwise, obviously)

But I stand happily corrected where I said they aren't in the picture at all.

That is an interesting press release because it outlines what they would have had to do with any data centre they were outsourcing to.

Re: Apple reveals new AI architecture built around Google Gemini models

#274
post #214
post #87

Earlier quoted context omitted.

From the link "Nvidia has its own “confidential computing” feature that encrypts data as it’s being processed, which will be used with other privacy and security measures to protect user data"

Yes, and how does the data get there?

Over TLS?

Re: Apple reveals new AI architecture built around Google Gemini models

#275
post #19

Earlier quoted context omitted.

The public version of Gemini is ridiculous. At least half their search "answers" are just wrong. If you then start a follow up chat the answers change but usually still half wrong. Search would be better without the added AI hallucinations above it. If I want an AI answer I'll go and ask Claude, the quality difference is huge.

It has to be really because think of how fast it has to come up with an answer (ie time for a regular google query) and the immense scale of billions of people querying it many times a day, all for free.

Just like search itself, caching does wonders. What do 90% of the people ask anyway but mundane, totally predictable questions?

Re: Apple reveals new AI architecture built around Google Gemini models

#276
post #87

Earlier quoted context omitted.

From the link "Nvidia has its own “confidential computing” feature that encrypts data as it’s being processed, which will be used with other privacy and security measures to protect user data"

Do you know if it end to end encrypted or the keys are managed by Google?

I think the keys are directly from Nvidia and Intel.

Re: Apple reveals new AI architecture built around Google Gemini models

#277

Earlier quoted context omitted.

I'd wager that for 99.9% of "Apple Intelligence" tasks, Google's models perform just as well as other frontier labs. Google also has done more work on getting LLMs running on edge devices compared to anthropic and openAI. The source also says > The new architecture centers on Apple Foundation Models co-developed with Google, which Apple says are adapted to run both on-device and on servers through its existing Privat…

That's not the point of OP. The point of OP is that Google is a direct competitor of Apple for phones / OS, so them giving the "key of the house" to Google is risky

A large portion of Apple's screens come from Samsung. Once a company is large enough, growing your business through supporting a competitor of another group at the company could be seen as a win-win.

Re: Apple reveals new AI architecture built around Google Gemini models

#278
post #273

Earlier quoted context omitted.

They are using Google Cloud. https://security.apple.com/blog/expanding-pcc/?linkId=100000... "Now, we are collaborating with Google and NVIDIA to run new Apple Intelligence workloads on Google Cloud, extending our industry-leading PCC privacy commitments to third-party data centers for the first time."

That is news — I guess not very surprising that they'd need more data centres than before. But again there is no Apple-to-Google transfer in the inference in the sense of the comment I was originally replying to (I am not suggesting you're implying otherwise, obviously) But I stand happily corrected where I said they aren't in the picture at all. That is an interesting press release because it outlines what they woul…

This is probably why Google had to rent compute from SpaceX. They needed to free up NVIDIA GPUs for Apple so they probably moved internal workloads to SpaceX compute.

Re: Apple reveals new AI architecture built around Google Gemini models

#279

Another one bites the dust What a blunder, they resisted AI for like 2 years when it was all the buzz, and now when the bubble is about to bust and every user has AI fatigue they decide to finally dip into the fad? Before it was as if avoiding AI was a conscious design decision, and if there was an AI crash, Apple would be the only survivor left. Now it feels like they weren't in on the meme out of incompetence and a…

When people say the AI bubble is about to bust, I don't think anybody means that "the use of AI is going to go away." AI is absurdly useful. I think what people mean is "the valuations of these companies will have to snap to a reality that is actually attached to their market value."

Exactly, small edge models is the future, highly personal experiences, and not these massive models that the cloud providers currently shove down our throats. While massive models are useful, these massive platforms are about to burst out of their promises. All while we’re supper happy with tiny 4b up to 12b models working amazing for all these “omg ai thinks” daily tasks.
Post reply on HN