For local LLM there are Ollama and LM Studio. How is this different?
This seems like a great question to ask an offline llm that runs on your mobile device. Does ollama and Lm studio run on your mobile device?
Ensu – Ente’s Local LLM app
91–100 of 198 posts
Re: Ensu – Ente’s Local LLM app
#92I like the idea of having a user-friendly app that lets you use LLMs locally. Tools like Ollama and LMStudio tend to put most people off because you have to decide for yourself which models to use and there are so many settings to configure. If the hardware you’re using is compatible, Ensu could be a drop-in replacement for casual ChatGPT users.
However, it’s a bit confusing because, for example, a larger LLM model was downloaded to my smartphone than to my computer. It would probably make the most sense if the app simply categorized devices into five different tiers and then, depending on which performance tier a device falls into, downloaded the appropriate model and simply informed the user of the performance tier. Over time, it would then be possible to periodically replace the LLM for each tier with better ones, or to redefine the device performance tiers based on hardware advancements.
Re: Ensu – Ente’s Local LLM app
#93> People called us crazy.
Absolutely no one called them crazy.
Re: Ensu – Ente’s Local LLM app
#94I would love to see a "distributed LLM" system, where people can easily setup a system to perform a "piece" of a "mega model" inference or training. Kind of like SETI@home but for an open LLM (like https://github.com/evilsocket/cake but massive ) Ideally if you "participate" in the network, you would get "credits" to use it proportionally to how much GPU power you have provided to the network. Or if you can't, then b…
https://docs.anarchai.org/
This was posted the other day, but only briefly made the front page - seems kinda like what you’re talking about
Re: Ensu – Ente’s Local LLM app
#95Earlier quoted context omitted.
While I would have the same reaction, in this case I think it is a sane decision. Ente is cornering the privacy market and I think they're doing a great job. They have a lot to lose (trust) and it would be stupid if they did something shady with the data entered in the 2FA app.
> cornering the privacy market this seems self-contradictory
Sorry, English is not my first language and I tried to look clever.
Re: Ensu – Ente’s Local LLM app
#96Earlier quoted context omitted.
Ente is extremely well known in the privacy circles, so this is not just some random company with a random app out of nowhere. Check PrivacyGuides for example.
Ok I checked privacyguides. Here’s where it was added to PrivacyGuides - https://github.com/privacyguides/privacyguides.org/issues/36... . The person opening the issue is the CEO of ente. So the CEO of ente gets his company mentioned in PrivacyGuides back when it was new and that makes it more legit?
PrivacyGuides goes through their own process of vetting (whether you would agree with their process or not that’s another topic) so I think the discussion to add Ente Photos is the more relevant link
https://discuss.privacyguides.net/t/ente-photo-management/11...
Re: Ensu – Ente’s Local LLM app
#97I like the idea of having a user-friendly app that lets you use LLMs locally. Tools like Ollama and LMStudio tend to put most people off because you have to decide for yourself which models to use and there are so many settings to configure. If the hardware you’re using is compatible, Ensu could be a drop-in replacement for casual ChatGPT users. However, it’s a bit confusing because, for example, a larger LLM model w…
Osaurus is what I use for local - it's a native Swift macOS app with sandboxing, agent tooling, and server capabilities. Mac only though.
Re: Ensu – Ente’s Local LLM app
#98Given how the blog is presented, I assumed this was something novel that solved a unique problem, maybe a local multi-modal assistant for your device. I installed it and it's none of that. It is a mere wrapper around small local LLM models. And, it's not even multi-modal! Anyone could've one-shotted this in Claude in an hour (I'm not exaggerating). What's the target audience here? Your average person doesn't care abo…
It’s a platform play so they can get people onto their defunct photos platform. “Big Tech” in a little suit.
Re: Ensu – Ente’s Local LLM app
#99Given how the blog is presented, I assumed this was something novel that solved a unique problem, maybe a local multi-modal assistant for your device. I installed it and it's none of that. It is a mere wrapper around small local LLM models. And, it's not even multi-modal! Anyone could've one-shotted this in Claude in an hour (I'm not exaggerating). What's the target audience here? Your average person doesn't care abo…
[deleted]
Re: Ensu – Ente’s Local LLM app
#100This sounds like an ad.
I am not a bot and I am not associated with this company in any way. But I am a happy user of Ente Auth as well. This AI thing they made however just gives off "we have to do something with AI or we'll be left behind" vibes.