Live data from Hacker News

Show HN: Off Grid – Run AI text, image gen, vision offline on your phone

github.com

1–10 of 71 posts

Show HN: Off Grid – Run AI text, image gen, vision offline on your phone

#1
Your phone has a GPU more powerful than most 2018 laptops. Right now it sits idle while you pay monthly subscriptions to run AI on someone else's server, sending your conversations, your photos, your voice to companies whose privacy policy you've never read. Off Grid is an open-source app that puts that hardware to work. Text generation, image generation, vision AI, voice transcription — all running on your phone, all offline, nothing ever uploaded.

That means you can use AI on a flight with no wifi. In a country with internet censorship. In a hospital where cloud services are a compliance nightmare. Or just because you'd rather not have your journal entries sitting in someone's training data.

The tech: llama.cpp for text (15-30 tok/s, any GGUF model), Stable Diffusion for images (5-10s on Snapdragon NPU), Whisper for voice, SmolVLM/Qwen3-VL for vision. Hardware-accelerated on both Android (QNN, OpenCL) and iOS (Core ML, ANE, Metal).

MIT licensed. Android APK on GitHub Releases. Build from source for iOS.

Show HN: Off Grid – Run AI text, image gen, vision offline on your phone
github.com

Re: Show HN: Off Grid – Run AI text, image gen, vision offline on your phone

#5
The repository is listed as offgrid-mobile everywhere on that page but is off-grid-mobile.

So the lastest releases is at https://github.com/alichherawalla/off-grid-mobile/releases/l...

And the clone would be: git clone https://github.com/alichherawalla/off-grid-mobile.git

Re: Show HN: Off Grid – Run AI text, image gen, vision offline on your phone

#9
post #6

Ok it lists the instruction to build for iOS, but how to sideload?

Wonder if you can use GitHub actions to build iOS.

I found a guide for virtual box macOS which failed on intel then another for hyper-V but haven’t tried that one yet.

Re: Show HN: Off Grid – Run AI text, image gen, vision offline on your phone

#10
Putting the power and the data of the users in the hands of the users themselves! Well done. Getting it setup was easy. Wish the app recognized the keyboard and realized when it was displayed so the bottom menu and chat box weren't hidden under it.
Post reply on HN