Impressive
Gemma 4 on iPhone
251–260 of 267 posts
Re: Gemma 4 on iPhone
#252Earlier quoted context omitted.
It’s so dispiriting to me that we’ve achieved those closest thing yet to an “objective truth” machine (with the caveat of garbage in, garbage out, etc.) and these big companies are either afraid to actually let it exist, want to push their own politics, or a combination of the two.
A collection of statistical patterns is hardly objective truth. If that’s what you think an LLM is, you’re mistaken.
Sure, but in case you've been living under a rock for the past year, that's exactly what people have been using it for for 2 years now.
Of course, it's actually an improvement over a Google search.
And, yeah, a bit of finetuning will change the LLMs opinion on any subject. Which the big companies probably see as an advantage.
Re: Gemma 4 on iPhone
#253Earlier quoted context omitted.
I have found that a lot of the techniques used to decensor models (as far as I can tell, they basically get all their weights to say no turned off) also make them really stupid. Like, sure, it will help you rob a bank, but if you ask whether you should rob the bank it will go "The positives: … The negatives: … My take: You should ABSOLUTELY rob the bank".
The abliteration in particular that Heretic does apparently results in a best-in-class lack of "stupefying" the underlying model. You haven't read its claims, apparently.
You can claim whatever you want I’m interested in evidence that this doesn’t happen
Re: Gemma 4 on iPhone
#254Earlier quoted context omitted.
I have found that a lot of the techniques used to decensor models (as far as I can tell, they basically get all their weights to say no turned off) also make them really stupid. Like, sure, it will help you rob a bank, but if you ask whether you should rob the bank it will go "The positives: … The negatives: … My take: You should ABSOLUTELY rob the bank".
I wonder if this is due to abliteration actually "damaging" the model, or just an artifact of the model never having been properly trained on "forbidden" topics (as it's enough for them to recognize them, and there's no point in dedicating neurons to something that will never be exercised anyway).
I’m not an expert and this is just a guess from the behavior but I feel like it’s kind of like giving the model a kind of Williams Syndrome, where (AFAIK) a common training process is that you keep asking it sensitive topics and every time it rejects the request you train it away from that and towards “Yeah, absolutely! Let’s go!!!” I feel like the natural result of this is that you’ll get something that is excited about whatever ideas you have?
Re: Gemma 4 on iPhone
#255It'd be fun to explore creating a Gemma 4 LLM API server app so you could use your iPhone's processing for agentic coding on a laptop. I don't know how useful it would be, but it'd be fun.
Re: Gemma 4 on iPhone
#256Earlier quoted context omitted.
I did not know about the trivially-produced botulinum toxin potential of garlic sitting in olive oil at room temperature. I'm going to guess that asking a cloud censored/non-abliterated LLM would not get me this information, despite it being useful as a warning, not just as a way for bad actors to poison people. > and I'm replying to someone who is surprised that even those minimal basics of guards exist Misrepresent…
> Misrepresentation of where I'm coming from. I literally failed to consider the weapon potential of biologics in this case (silly me). I was only thinking about the fact that they cured (essentially) my psoriasis. Thank you for the correction. > Bad actors will always exist, but fortunately will always be outnumbered by good actors with access to the same tools. So while I understand your pressing for caution, I sti…
OK, let's take guns out of the equation then.
Would you say that what stops bad guys using knives and fists is good guys with knives and fists? Why or why not? What makes guns different?
(The gun debate is my favorite one because there are IMHO strong arguments on both sides. Also, there is no way the US would have ever existed as an independent state if the US hadn't used guns to defeat the British, so it's stuck in the DNA of the United States for good.)
Personally my contrarian opinion is that we should make it very difficult for men below the age of 25, and any man going through a divorce and/or who lost a job, from being able to obtain a gun (in the latter case, "for some period of time" to be left for others to define). That would rule out like 90% of the problem, even if the solution is sexist.
Re: Gemma 4 on iPhone
#257Earlier quoted context omitted.
I did not know about the trivially-produced botulinum toxin potential of garlic sitting in olive oil at room temperature. I'm going to guess that asking a cloud censored/non-abliterated LLM would not get me this information, despite it being useful as a warning, not just as a way for bad actors to poison people. > and I'm replying to someone who is surprised that even those minimal basics of guards exist Misrepresent…
> Misrepresentation of where I'm coming from. I literally failed to consider the weapon potential of biologics in this case (silly me). I was only thinking about the fact that they cured (essentially) my psoriasis. Thank you for the correction. > Bad actors will always exist, but fortunately will always be outnumbered by good actors with access to the same tools. So while I understand your pressing for caution, I sti…
On the gun thing, perhaps there's another controllable variable we're not focusing enough on...
https://www.police1.com/active-shooter/articles/report-man-w...
Re: Gemma 4 on iPhone
#258This app is cool and it showcases some use cases, but it still undersells what the E2B model can do. I just made a real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B. I posted it on /r/LocalLLaMA a few hours ago and it's gaining some traction [0]. Here's the repo [1] I'm running it on a Macbook instead of an iPhone, but based on the benchmark here [2], you should be able to run the same thing on an…
[dead]
Re: Gemma 4 on iPhone
#259Earlier quoted context omitted.
I tried it on my mac, for coding, and I wasn't really impressed compared to Qwen. I guess there are things it's better at?
Assuming you’re not copy/pasting for these tasks. What’s the stack required to use local models for coding? I’ve got a capable enough machine to produce tokens slowly, but don’t understand how to connect that to the likes of VSCode or a JetBrains ide.
You can check OpenCode or Pi Agent to have an interactive app running on terminal and change you local code directly.
I believe OpenCode also has a VSCode extension if you want to have it directly in your IDE, but I don't think it's necessary anyway.
Re: Gemma 4 on iPhone
#260[dead]