Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemma 4 on iPhone

apps.apple.com

Post reply on HN
Print view View original

151–160 of 267 posts

Re: Gemma 4 on iPhone

#151

Post by dang »

karimf wrote: post #40

This app is cool and it showcases some use cases, but it still undersells what the E2B model can do. I just made a real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B. I posted it on /r/LocalLLaMA a few hours ago and it's gaining some traction [0]. Here's the repo [1] I'm running it on a Macbook instead of an iPhone, but based on the benchmark here [2], you should be able to run the same thing on an…

Re-upped here:

Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B - https://news.ycombinator.com/item?id=47652007

Re: Gemma 4 on iPhone

#152

Post by onion2k »

nothinkjustai wrote: post #113
pmarreck wrote: post #109

Earlier quoted context omitted.

Holy hell, how new is this? I've never heard of it, looks great!

It’s completely vibe coded, doesn’t even run on my Mac lol

Software that doesn't work has been available for decades. It's not a good signal for vibe-coding.

Re: Gemma 4 on iPhone

#153

Post by karimf »

storus wrote: post #143
karimf wrote: post #40

This app is cool and it showcases some use cases, but it still undersells what the E2B model can do. I just made a real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B. I posted it on /r/LocalLLaMA a few hours ago and it's gaining some traction [0]. Here's the repo [1] I'm running it on a Macbook instead of an iPhone, but based on the benchmark here [2], you should be able to run the same thing on an…

That's cool! You can add SoulX-FlashHead for real-time AI head animation as well if you want to simulate a teacher.

Thanks for sharing! I'm still torn about it. Sure it'll feel more natural if you have the AI head animation, but I don't want people to get attached to it. I don't want to make the loneliness epidemic even worse.

Re: Gemma 4 on iPhone

#154

Post by cobicobi »

om252345 wrote: post #145
jeroenhd wrote: post #12

English version of the page: https://apps.apple.com/us/app/google-ai-edge-gallery/id67496... Also on Android: https://play.google.com/store/apps/details?id=com.google.ai.... It's a demo app for Google's Edge project: https://ai.google.dev/edge

Gemma4 works really slow on my android e2b model on Samsung galaxy s21 ultra. Atleast 20-30 sec to warm up and then reply.

need s24 ultra and above i think

Re: Gemma 4 on iPhone

#156

Post by bigyabai »

al_borland wrote: post #137

I find it odd they are using the term “edge” to brand this, if it’s target is the general public. I’ve been to a few tech conferences and saw the term used there for the first time. It took me a little bit to see the pattern and understand what it meant. I have never heard the term used outside of those circles. It seems like “local” would be the term average users would be familiar with. Normal people don’t call the…

> if it’s target is the general public.

It's not - Apple is working with Google right now to make Siri into the public-facing version of this. This is kinda just the tech preview before all the branding has been painted on.

Re: Gemma 4 on iPhone

#158

Post by karimf »

dang wrote: post #151
karimf wrote: post #40

This app is cool and it showcases some use cases, but it still undersells what the E2B model can do. I just made a real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B. I posted it on /r/LocalLLaMA a few hours ago and it's gaining some traction [0]. Here's the repo [1] I'm running it on a Macbook instead of an iPhone, but based on the benchmark here [2], you should be able to run the same thing on an…

Re-upped here: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B - https://news.ycombinator.com/item?id=47652007

Oh wow, that's awesome. Thanks a lot, dang!

Re: Gemma 4 on iPhone

#159

Post by mudkipdev »

allpratik wrote: post #63

Nice! Tried on iPhone 16 pro with 30 TPS from Gemma-4-E2B-it model. Although the phone got considerably hot while inferencing. It’s quite an impressive performance and cannot wait to try it myself in one of my personal apps.

It's strange that my iPhone 14 is at regular temperature when using the E2B model. But also it's a lot slower (not sure how to measure the exact tokens per second, ~12 if I had to guess)

Re: Gemma 4 on iPhone

#160

Post by green7ea »

Mil0dV wrote: post #75
kgeist wrote: post #70

Earlier quoted context omitted.

Qwen3.5 comes in various sizes (including 27B), and judging by the posts on HN, /LocalLlama etc., it seems to be better at logic/reasoning/coding/tool calling compared to Gemma 4, while Gemma 4 is better at creative writing and world knowledge (basically nothing changed from the Qwen3 vs. Gemma3 era)

Does this also apply to gemma's 26B-A4B vs say Qwens 35B-A3B? I'm not sure if I can make the 35B-A3B work with my 32GB machine

It should be easy with a Q4 (quantization to 4 bits per weight) and a smallish context.

You won't have much RAM left over though :-/.

At Q4, ~20 GiB

https://huggingface.co/unsloth/Qwen3.5-35B-A3B-GGUF

Post reply on HN