I need normal server too
in local network I can run chat in other device and 'counting' on iphone.
Second idea is input audio in other language, like Czech, Polish, French
Gemma 4 on iPhone
191–200 of 267 posts
Re: Gemma 4 on iPhone
#192The description says it's private, but the legalese it makes you agree to makes no promise. Rather, the opposite: > We collect information about your activity in our services Source: https://policies.google.com/privacy#infocollect
I was about to ask if anybody had looked at what it was sending home. I’m travelling so I’m not in a position to run this through a proxy for a couple of weeks, but also I’m travelling so this could be useful!
Re: Gemma 4 on iPhone
#193Earlier quoted context omitted.
Does this also apply to gemma's 26B-A4B vs say Qwens 35B-A3B? I'm not sure if I can make the 35B-A3B work with my 32GB machine
It should be easy with a Q4 (quantization to 4 bits per weight) and a smallish context. You won't have much RAM left over though :-/. At Q4, ~20 GiB https://huggingface.co/unsloth/Qwen3.5-35B-A3B-GGUF
For llama-server (and possibly other similar applications) you can specify the number of GPU layers (e.g. `--n-gpu-layers`). By default this is set to run the entire model in VRAM, but you can set it to something like 64 or 32 to get it to use less VRAM. This trades speed as it will need to swap layers in and out of VRAM as it runs, but allows you to run a larger model, larger context, or additional models.
Re: Gemma 4 on iPhone
#194Earlier quoted context omitted.
> And there's a whole set of ethically-justifiable but rule-flagging conversations (loosely categorizable as things like "sensitive", "ethically-borderline-but-productive" or "violating sacred cows") that are now possible with this, and at a level never before possible until now. I checked the abliterate script and I don't yet understand what it does or what the result is. What are the conversations this enables?
1) Coming up with any valid criticism of Islam at all (for some reason, criticisms of Christianity or Judaism are perfectly allowed even with public models!). 2) Asking questions about sketchy things. Simply asking should not be censored. 3) I don't use it for this, but porn or foul language. 4) Imitating or representing a public figure is often blocked. 5) Asking security-related questions when you are trying to do…
7) ChatGPT wouldn’t let me generate a fake high bank account balance screenshot (was meant to be a response to all the “vibe coding can make anybody rich now” posts I saw on X)
8) ChatGPT wouldn’t let me generate a script to crack a password (even though I suspected I knew all but 2 characters in a 16 character password, which makes it highly unlikely I’m randomly trying to hack something)
The stupidest part of this is I could easily do these things myself, I just wanted to save a few minutes.
Re: Gemma 4 on iPhone
#195I’d recommend locally.ai[1] - it’s really good and has a wide range of models. Also has shortcuts support.
1. https://apps.apple.com/gb/app/locally-ai-local-ai-chat/id674...
Re: Gemma 4 on iPhone
#196The description says it's private, but the legalese it makes you agree to makes no promise. Rather, the opposite: > We collect information about your activity in our services Source: https://policies.google.com/privacy#infocollect
The app is open source[0], although given Apple's stance on sideloading it's hard to confirm if you're using the open version. [0] https://github.com/google-ai-edge/gallery
Two (very quick) minutes on their GitHub repo and it's pretty obvious that they're using firebase-analytics and at the very least seem to be sending URLs[1] and infos such as the model you download or the capacities[2] you use.
[1] https://github.com/google-ai-edge/gallery/blob/main/Android/...
[2] https://github.com/google-ai-edge/gallery/blob/main/Android/...
Re: Gemma 4 on iPhone
#197Would it work locally on a Mac Pro M4 24gb? If so I'd really appreciate a step-by-step guide.
These E2B and E4B models are very small so that they can fit into phones with around 8gb of RAM. You can get away with a much larger model. Just run: brew install ollama ollama run gemma4:26b-a4b-it-q4_K_M
Legend! Thanks heaps.
Re: Gemma 4 on iPhone
#198good model!
Re: Gemma 4 on iPhone
#199[dead]
Re: Gemma 4 on iPhone
#200Earlier quoted context omitted.
From what I've seen gemma 4 doesn't refuse a lot regarding sex, it only needs little nudging in the right direction sometimes. But it does refuse being critical of the usual topics: israel, islam, trans, or race. So wanting to discuss one of those is the real reason people would use an uncensored model.
It’s so dispiriting to me that we’ve achieved those closest thing yet to an “objective truth” machine (with the caveat of garbage in, garbage out, etc.) and these big companies are either afraid to actually let it exist, want to push their own politics, or a combination of the two.
A collection of statistical patterns is hardly objective truth. If that’s what you think an LLM is, you’re mistaken.