As someone who saw this and was interested but also skeptical of this being low effort are there other open projects for running small models locally on android / iOS? I've found https://github.com/alichherawalla/off-grid-mobile-ai but haven't tried anything in this space yet.
Ensu – Ente’s Local LLM app
141–150 of 198 posts
Re: Ensu – Ente’s Local LLM app
#142I love Ente Auth, but Ente (as a company/organization) does a somewhat poor job of calling out their non-photos apps in their branding and on their website. If you go to the "Download" button at the top of the page on this page about their LLM chat app, it downloads... their photo sharing application. If you click Sign Up, it takes you to a signup page with the browser title "Ente Photos" but the page text says "Priv…
EDIT: and there are long-standing bugs like this one, unaddressed: https://github.com/ente-io/ente/issues/3087
Re: Ensu – Ente’s Local LLM app
#143Re: Ensu – Ente’s Local LLM app
#144Heard the first time about them (ente) yesterday in a discussion about "which 2FA are u using?". Directly switched to https://ente.com/auth/ on Android and Linux Desktop and very happy with it. Going to give this a try...
I was just thinking their end goal seems to be to harvest creds by putting their own rebadged distribution of local models. That’s the only “business” model that makes sense. Expressly harvesting creds through a 2FA app seems a little more direct.
Re: Ensu – Ente’s Local LLM app
#145[flagged]
Re: Ensu – Ente’s Local LLM app
#146They also have a TOTP auth app?
If their photos app stopped crashing and they pursued basic feature parity between their iOS and desktop apps (IMO table stakes for a photo sync service) I'd have no issue recommending them. Instead, it seems like every so often they just branch off into a new direction, leaving the existing products unfinished. It's like Mozilla-level lack of focus.
Re: Ensu – Ente’s Local LLM app
#147Earlier quoted context omitted.
https://docs.anarchai.org/ This was posted the other day, but only briefly made the front page - seems kinda like what you’re talking about
Oooh thanks a lot. This looks promising. Maybe the only missing thing would be sone kind of (economic) incentive to share GPU power. Although the ability to use large models "for free" sounds pretty rad.
Re: Ensu – Ente’s Local LLM app
#148I like Ente, but isn't their core product a photos application? Its offshoots like this and 2FA feel incongruous.
Their core product is local ML inference in the context of a photo app, i.e. a drop-in cloud dependency removal/replacement for non-technical, privacy-conscious users as well as those who want advanced functionality offline. This does the same for language models.
Re: Ensu – Ente’s Local LLM app
#149Given how the blog is presented, I assumed this was something novel that solved a unique problem, maybe a local multi-modal assistant for your device. I installed it and it's none of that. It is a mere wrapper around small local LLM models. And, it's not even multi-modal! Anyone could've one-shotted this in Claude in an hour (I'm not exaggerating). What's the target audience here? Your average person doesn't care abo…
It’s a platform play so they can get people onto their defunct photos platform. “Big Tech” in a little suit.
Re: Ensu – Ente’s Local LLM app
#150I love Ente Auth, but Ente (as a company/organization) does a somewhat poor job of calling out their non-photos apps in their branding and on their website. If you go to the "Download" button at the top of the page on this page about their LLM chat app, it downloads... their photo sharing application. If you click Sign Up, it takes you to a signup page with the browser title "Ente Photos" but the page text says "Priv…
This is one of the reason I, as their user, am moving away. Things feel half-baked and I stopped trusting it with my data. I self host and the details for this were all over the place. Some of my contributions cleaning up the docs were rejected, so I grew even more wary. I am moving to Immich, even though I'd prefer e2ee for my photos even if I self host them. EDIT: and there are long-standing bugs like this one, una…