Live data from Hacker News

Ensu – Ente’s Local LLM app

ente.com

101–110 of 198 posts

Re: Ensu – Ente’s Local LLM app

#101
post #66

Given how the blog is presented, I assumed this was something novel that solved a unique problem, maybe a local multi-modal assistant for your device. I installed it and it's none of that. It is a mere wrapper around small local LLM models. And, it's not even multi-modal! Anyone could've one-shotted this in Claude in an hour (I'm not exaggerating). What's the target audience here? Your average person doesn't care abo…

Local LLM options for less technical people is worth celebrating IMO. No, not "anybody" can have one-shotted this in CC in an hour.

We have not seen a tidal wave of untechnical people vibe coding up their own software solutions.

Re: Ensu – Ente’s Local LLM app

#102
post #16

Weird hype going on here in comments.

Also weird arrogance. Yeah, somebody else could have vibe coded it in a week. But they didn't, so they don't get the 100 HN klout points for it.

Helping non-technical people get off of ChatGPT.com and using increasingly better local models seems worth celebrating and continued iteration.

Re: Ensu – Ente’s Local LLM app

#104
post #74

I would love to see a "distributed LLM" system, where people can easily setup a system to perform a "piece" of a "mega model" inference or training. Kind of like SETI@home but for an open LLM (like https://github.com/evilsocket/cake but massive ) Ideally if you "participate" in the network, you would get "credits" to use it proportionally to how much GPU power you have provided to the network. Or if you can't, then b…

https://psyche.network/runs

Re: Ensu – Ente’s Local LLM app

#105
post #74

I would love to see a "distributed LLM" system, where people can easily setup a system to perform a "piece" of a "mega model" inference or training. Kind of like SETI@home but for an open LLM (like https://github.com/evilsocket/cake but massive ) Ideally if you "participate" in the network, you would get "credits" to use it proportionally to how much GPU power you have provided to the network. Or if you can't, then b…

[deleted]

Re: Ensu – Ente’s Local LLM app

#106
post #66

Given how the blog is presented, I assumed this was something novel that solved a unique problem, maybe a local multi-modal assistant for your device. I installed it and it's none of that. It is a mere wrapper around small local LLM models. And, it's not even multi-modal! Anyone could've one-shotted this in Claude in an hour (I'm not exaggerating). What's the target audience here? Your average person doesn't care abo…

I hate to say it, but this looks like the sort of thing a CEO told their team to build on Monday morning in a panic because they are grasping for ways to participate in the AI craze. And the team did just that: they built it that morning using Claude Code.

There is truly nothing original here and the product doesn't have a chance in hell of earning money. Local LLMs on-device will be dominated by the device vendors, whose control of the hardware stack combined with their ability to subsidize billions of dollars of machine learning research gives them an unfair advantage. Apple knows what the next generation of silicon will deliver, and their ML engineers are already hard at work building models that will be highly optimized for that silicon a year or two ahead of time. Open source models are really great and are backed by well funded labs; however, delivering these models on-device in a way that pleases users will never be easier than it is for the vendors of the devices.

Plus, device vendors have ways of making money from local LLMs that third-party app providers do not. They can make their local LLM free and earn money on the hardware play, without skipping a beat on the billions of dollars of ongoing R&D. I don't see how third party app vendors make money here when they will be competing with the decent, totally free alternative that Apple and Google (and Samsung etc.) will load on in the next year or two.

Re: Ensu – Ente’s Local LLM app

#107
post #66

Given how the blog is presented, I assumed this was something novel that solved a unique problem, maybe a local multi-modal assistant for your device. I installed it and it's none of that. It is a mere wrapper around small local LLM models. And, it's not even multi-modal! Anyone could've one-shotted this in Claude in an hour (I'm not exaggerating). What's the target audience here? Your average person doesn't care abo…

Probably just another ollama-type service who wants to slide themselves in between the user and local models, so they can take all the credit and work on convenience based platform lock-in, then later introduce paid tiers.

Re: Ensu – Ente’s Local LLM app

#108

I like the idea of having a user-friendly app that lets you use LLMs locally. Tools like Ollama and LMStudio tend to put most people off because you have to decide for yourself which models to use and there are so many settings to configure. If the hardware you’re using is compatible, Ensu could be a drop-in replacement for casual ChatGPT users. However, it’s a bit confusing because, for example, a larger LLM model w…

LLMStudio is pretty darn easy and if I recall it recommends a model to install when you first start it

Re: Ensu – Ente’s Local LLM app

#109
post #66

Given how the blog is presented, I assumed this was something novel that solved a unique problem, maybe a local multi-modal assistant for your device. I installed it and it's none of that. It is a mere wrapper around small local LLM models. And, it's not even multi-modal! Anyone could've one-shotted this in Claude in an hour (I'm not exaggerating). What's the target audience here? Your average person doesn't care abo…

Local LLM options for less technical people is worth celebrating IMO. No, not "anybody" can have one-shotted this in CC in an hour. We have not seen a tidal wave of untechnical people vibe coding up their own software solutions.

To add to this, the value that ente or someone like that can bring to the table here is a firm pledge to improve it and maintain it going forward.

That to me is more valuable than code vibe coded by Claude in one afternoon.

Post reply on HN