Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemma 3n preview: Mobile-first AI

developers.googleblog.com

Post reply on HN
Print view View original

61–70 of 179 posts

Re: Gemma 3n preview: Mobile-first AI

#61

Post by sureglymop »

rhdjsjebshjffn wrote: post #32
esafak wrote: post #5

Earlier quoted context omitted.

Imagine a model smarter than most humans that fits on your phone. edit: I seem to be the only one excited by the possibilities of such small yet powerful models. This is an iPhone moment: a computer that fits in your pocket, except this time it's smart.

I can't speak for anyone else, but these models only seem about as smart as google search, with enormous variability. I can't say I've ever had an interaction with a chatbot that's anything redolent of interaction with intelligence. Now would I take AI as a trivia partner? Absolutely. But that's not really the same as what I look for in "smart" humans.

The image description capabilities are pretty insane, crazy to think it's all happening on my phone. I can only imagine how interesting this is accessibility wise, e.g. for vision impaired people. I believe there are many more possible applications for these on a smartphone than just chatting with them.

Re: Gemma 3n preview: Mobile-first AI

#62

Post by koakuma-chan »

hmapple wrote: post #60
rhdjsjebshjffn wrote: post #32

Earlier quoted context omitted.

I can't speak for anyone else, but these models only seem about as smart as google search, with enormous variability. I can't say I've ever had an interaction with a chatbot that's anything redolent of interaction with intelligence. Now would I take AI as a trivia partner? Absolutely. But that's not really the same as what I look for in "smart" humans.

Have you tried any SOTA models like o3? If not, I strongly encourage you to discuss your area of expertise with it and rate based on that It is incredibly competent

[flagged]

Re: Gemma 3n preview: Mobile-first AI

#63

Post by sureglymop »

barnas2 wrote: post #22

Is anyone able to test it via AiStudio? I pay for Google's AI subscription, but any attempt to use this model results in a message telling me I've hit my rate limit.

Tested it on my Android phone with Google Edge Gallery. No sign up required although a hugging face login is required to download the models in order to import them into the app.

Re: Gemma 3n preview: Mobile-first AI

#64

Post by elpakal »

lxgr wrote: post #15
onlyrealcuzzo wrote: post #14

Earlier quoted context omitted.

That sounds like a problem iOS will eventually deal with, as many apps are going to want this technology, and since Apple distributes apps - they aren't interested in the average app being 10x larger when they could solve the problem easily. Though, I won't be surprised if they try to force devs to use their models for "privacy" (and not monopolistic reasons, of course).

Given Apple's track record in dealing with the problem of ballooning app sizes, I'm not holding my breath. The incentives are just not aligned – Apple earns $$$ on each GB of extra storage users have to buy.

I don't know how true your comment is about them earning money on each GB, but if you're interested in app size analysis on iOS I made this for that reason https://dotipa.app.

I occasionally post decompositions of public .ipa's on the App Store, and I'm looking forward to seeing how these change over the next year.

Re: Gemma 3n preview: Mobile-first AI

#67

Post by [deleted] »

rhdjsjebshjffn wrote: post #32
esafak wrote: post #5

Earlier quoted context omitted.

Imagine a model smarter than most humans that fits on your phone. edit: I seem to be the only one excited by the possibilities of such small yet powerful models. This is an iPhone moment: a computer that fits in your pocket, except this time it's smart.

I can't speak for anyone else, but these models only seem about as smart as google search, with enormous variability. I can't say I've ever had an interaction with a chatbot that's anything redolent of interaction with intelligence. Now would I take AI as a trivia partner? Absolutely. But that's not really the same as what I look for in "smart" humans.

[deleted]

Re: Gemma 3n preview: Mobile-first AI

#68

Post by jdiff »

zamadatix wrote: post #37
Deathmax wrote: post #4

Earlier quoted context omitted.

It's not a 4B parameter model. The E4B variant is 7B parameters with 4B loaded into memory when using per-layer embedding cached to fast storage, and without vision or audio support.

The link says E2B and E4B have 4B and 8B raw parameters, where do you see 7B?

There's a 7B mentioned in the chat arena ELO graph, I don't see any other references to it though.

Re: Gemma 3n preview: Mobile-first AI

#69

Post by TOMDM »

Having played with MCP a bit now, seeing this makes me think there's huge potential in Android MCP servers bolted into Androids permission system.

Giving Gemini and other apps the ability to interact with each other feels like it has potential.

Re: Gemma 3n preview: Mobile-first AI

#70

Post by numpad0 »

lxgr wrote: post #15
onlyrealcuzzo wrote: post #14

Earlier quoted context omitted.

That sounds like a problem iOS will eventually deal with, as many apps are going to want this technology, and since Apple distributes apps - they aren't interested in the average app being 10x larger when they could solve the problem easily. Though, I won't be surprised if they try to force devs to use their models for "privacy" (and not monopolistic reasons, of course).

Given Apple's track record in dealing with the problem of ballooning app sizes, I'm not holding my breath. The incentives are just not aligned – Apple earns $$$ on each GB of extra storage users have to buy.

They earn from in-app purchases too!
Post reply on HN