This rules. Godspeed!
Show HN: Off Grid – Run AI text, image gen, vision offline on your phone
21–30 of 71 posts
Re: Show HN: Off Grid – Run AI text, image gen, vision offline on your phone
#22This rules. Godspeed!
wow. thank you
Re: Show HN: Off Grid – Run AI text, image gen, vision offline on your phone
#23[dead]
Re: Show HN: Off Grid – Run AI text, image gen, vision offline on your phone
#24[dead]
> that's basically usable for real conversations.
That's using the word "real" very loosely.
Re: Show HN: Off Grid – Run AI text, image gen, vision offline on your phone
#25[dead]
I've added a section for recommended models. So basically you can chose from there.
I'd recommend going for any quantized 1B parameter model. So you can look at llama 3.2 1B, gemma3 1B, qwen3 VL 2B (if you'd like vision)
Appreciate the kind words!
Re: Show HN: Off Grid – Run AI text, image gen, vision offline on your phone
#26[dead]
This sounds exactly like Claude wrote it. I've noticed Claude saying "genuinely" a lot lately, and the "real killer feature" segue just feels like Claude being asked to review something.
Re: Show HN: Off Grid – Run AI text, image gen, vision offline on your phone
#27Earlier quoted context omitted.
I can confirm this bug on a Samsung S24 Ultra.
sorry about that one. I'm taking a look and fixing it right away
hey, just pushed a fix for it here: https://github.com/alichherawalla/off-grid-mobile/releases/t...
Thanks for spotting and reporting this.
Re: Show HN: Off Grid – Run AI text, image gen, vision offline on your phone
#28Nice idea, but isnt this kind of daft?
There are basically no useful models that run on phone hardware.
> Results vary by model size and quantization.
I bet they do.
Look, if you cant run models on your desktop, theres no way in hell they run on your phone.
The problem with all of these self hosting solutions is that the actual models you can run on them aren't any good.
Not like, “chat gpt a year ago” not good.
Like, “its a potato pop pop” no good.
Unsloth has a good guide on running qwen3 (1), and the tldr is basically, its not really good unless you run a big version.
The iphone 17 pro has 12GB of ram.
That is, to be fair, enough to run some small stable diffusion models, but it isnt enough to run run a decent quant of qwen3.
You need about 64 GB for that.
So… i dunno. This feels like a bunch of empty promises; yes, technically it can run some models, but how useful is it actually?
Self hosting needs next gen hardware.
This gen of desktop hardware isnt good enough, even remotely, to compare to server api options.
Running on mobile devices is probably still a way away.
(1) - https://unsloth.ai/docs/models/qwen3-how-to-run-and-fine-tun...
Re: Show HN: Off Grid – Run AI text, image gen, vision offline on your phone
#29Nice idea, but isnt this kind of daft? There are basically no useful models that run on phone hardware. > Results vary by model size and quantization. I bet they do. Look, if you cant run models on your desktop, theres no way in hell they run on your phone. The problem with all of these self hosting solutions is that the actual models you can run on them aren't any good. Not like, “chat gpt a year ago” not good. Like…
I think if people will people know how accessible it is to run local LLMs on their device they will consider buying devices with more memory that will be able to run better models. Local LLMs in the long run are game changers
Re: Show HN: Off Grid – Run AI text, image gen, vision offline on your phone
#30Nice idea, but isnt this kind of daft? There are basically no useful models that run on phone hardware. > Results vary by model size and quantization. I bet they do. Look, if you cant run models on your desktop, theres no way in hell they run on your phone. The problem with all of these self hosting solutions is that the actual models you can run on them aren't any good. Not like, “chat gpt a year ago” not good. Like…
[deleted]