Is it me, or does the article sound like LLM output? The pattern "It's not mere X — it's Y", occurs like 4 times in the text :v
An AI slop pattern so widespread it’s now referred to as “it’s not pee pee it’s poo poo”.
Google Gemma 4 Runs Natively on iPhone with Full Offline AI Inference
51–60 of 196 posts
Re: Google Gemma 4 Runs Natively on iPhone with Full Offline AI Inference
#52Unfortunately Apple appears to be blocking the use of these llms within apps on their app store. I've been trying to ship an app that contains local llms and have hit a brick wall with issue 2.5.2
What is your app doing? Just LLM inference?
Re: Google Gemma 4 Runs Natively on iPhone with Full Offline AI Inference
#53Earlier quoted context omitted.
I think Apple will become increasingly draconian about LLMs. Very soon people won't need to buy many of their apps. They can just make them. This threatens Apple's entire business model.
But… why would I put the effort into getting an llm to make me an app when a there’s an existing app that I don’t have to maintain? I don’t want to have to make every app I use?
There's a huge difference between local apps that cost one time 3-10$ and apps that ask for a subscription between 5 to 20$ per month. the first category will remain and might become more popular as quality increases, the second category will be oblitereated as the value isn't there, even if all the buyers are rich. The second group takes up a much larger part of the pie than the first though, so apple's revenue will decrease.
Re: Google Gemma 4 Runs Natively on iPhone with Full Offline AI Inference
#54Re: Google Gemma 4 Runs Natively on iPhone with Full Offline AI Inference
#55Unfortunately Apple appears to be blocking the use of these llms within apps on their app store. I've been trying to ship an app that contains local llms and have hit a brick wall with issue 2.5.2
I think Apple will become increasingly draconian about LLMs. Very soon people won't need to buy many of their apps. They can just make them. This threatens Apple's entire business model.
VibeOS. It’s just an LLM from which all other userspace is vibed.
Re: Google Gemma 4 Runs Natively on iPhone with Full Offline AI Inference
#56Is it me, or does the article sound like LLM output? The pattern "It's not mere X — it's Y", occurs like 4 times in the text :v
You would be correct. Ran the article through GPTZero, 100% AI.
Re: Google Gemma 4 Runs Natively on iPhone with Full Offline AI Inference
#57I just installed Google Ai Edge Gallery on my iPhone 16 pro, here are the results of the first benchmark with GPU, Prefill Tokens=256, Decode Tokens=256, Number of runs: 3. Prefill Speed=231t/s, Decode Speed=16t/s, Time to First Token=1.16s, First init time=20s
Re: Google Gemma 4 Runs Natively on iPhone with Full Offline AI Inference
#58I’m pretty excited about the edge gallery ios app with gemma 4 on it but it seems like they hobbled it, not giving access to intents and you have to write custom plugins for web search, etc. Does anyone have a favorite way to run these usefully? ChatMCP works pretty well but only supports models via api.
Re: Google Gemma 4 Runs Natively on iPhone with Full Offline AI Inference
#59Re: Google Gemma 4 Runs Natively on iPhone with Full Offline AI Inference
#60You are referring to the edge models, right? E2B and E4B, not the bigger ones (26B, 31B)...