Live data from Hacker News

Apple Is in Talks to Let Google's Gemini Power iPhone Generative AI Features

bloomberg.com

1–10 of 130 posts

Re: Apple Is in Talks to Let Google's Gemini Power iPhone Generative AI Features

#5

Neither Google nor OpenAI's infra could handle the potential scale of Apple's userbase, given the scaling issues both companies are having. Even Google doesn't have enough GPUs.

Gemini doesn't run on GPUs, it runs on Google's custom TPU silicon.

The TPU v4 was already competitive with Nvidia, and the new v5p is 2.4 times faster and more power efficient than v4.

Re: Apple Is in Talks to Let Google's Gemini Power iPhone Generative AI Features

#8
post #5

Neither Google nor OpenAI's infra could handle the potential scale of Apple's userbase, given the scaling issues both companies are having. Even Google doesn't have enough GPUs.

Gemini doesn't run on GPUs, it runs on Google's custom TPU silicon. The TPU v4 was already competitive with Nvidia, and the new v5p is 2.4 times faster and more power efficient than v4.

That may be true: the economics of TPUs are more complicated but they certainly aren't as much in demand.

Re: Apple Is in Talks to Let Google's Gemini Power iPhone Generative AI Features

#9

I thought they wanted to do their own thing and focused on efficient inference on device. Disappointed to hear this...

The article is pretty clear that it's going to be a service offered as a secondary option instead of core functionality.

>Apple is preparing new capabilities as part of iOS 18 — the next version of the iPhone operating system — based on its own AI models. But those enhancements will be focused on features that operate on its devices, rather than ones delivered via the cloud. So Apple is seeking a partner to do the heavy lifting of generative AI, including functions for creating images and writing essays based on simple prompts.

Re: Apple Is in Talks to Let Google's Gemini Power iPhone Generative AI Features

#10

If Apple uses a third party to provide this what the heck has the Siri team been doing the last five years?

Apple put themselves in the corner with their privacy-first approach and local computations. To evolve AI you need to get all the data you can. It’s unsurprising that Apple progress was slow. And now they will pay to the Google who doesn’t hesitate to extract data from the users.
Post reply on HN