131–140 of 299 posts
I am somewhat surprised that this app doesn't seem to offer any way to connect to a remote Ollama instance. The most powerful computer I own isn't necessarily the one I'm running the GUI on.
The app does have a function to expose Ollama to the network, so perhaps its coming?
If you’re a power user of these LLMs and have coding experience, I actually recommend just whipping together your own bespoke chat UI that you can customize however you like. Grab any OpenAI compatible endpoint for inference and a frontend component framework (many of which have added standard Chat components) - the rest is almost trivial. I threw one together in a week with Gemini’s assistance and now I use it every…
[flagged]
Please avoid internet tropes on HN.
Earlier quoted context omitted.
Kinda odd to be so dismissive of this mindset given this websites title. Whipping up your own chatui really is not that hard and is a pretty fun exercise. Knowing how your tools work and being able to tweak them to your specific usecases kinda rules!
There is a big difference between fun exercise and actually creating something that competes with the apps you can download. Building something on par with Claude Desktop, ChatGPT Desktop, etc. would be a lot of work. And I don't think the payoff would be there for most people.
I've been on something of a quest to find a really good chat interface for LLMs. Most import feature for me is that I want to be able to chat with local models, remote models on my other machines, and cloud models (OpenAI API compatible). Anything that makes it easier to switch between models or query them simultaneously is important. Here's what I've learned so far: * Msty - my current favorite. Can do true simultan…
Electron. Python backend. Can talk to Ollama and other backends.
Need help with design and packaging.
Earlier quoted context omitted.
We don't have this kind of power, and in fact, most our posts gets deleted so we don't post. We do read comments and help if we can. Negative comments help us grow and make Ollama better any way. We can take harsh feedback to make Ollama better.
To be clear, I didn't meant you guys manipulate the comments. It was just weird seeing even @swyx's comment get that much downvotes.
Some comments have been downweighted for being generic or off-topic, which is standard moderation; our role as moderators is to keep the discussion threads on-topic. But the comment that was left at the top of the thread after I'd done that seemed at least somewhat negative/critical towards the Ollama team.
Which comments seem unreasonably low to you?
I am somewhat surprised that this app doesn't seem to offer any way to connect to a remote Ollama instance. The most powerful computer I own isn't necessarily the one I'm running the GUI on.
Earlier quoted context omitted.
Is there a way to get LM Studio to talk to remote OpenAI API servers and cloud providers?
LM Studio is for hosting/serving local LLMs. Its chat UI is secondary and is pretty limited.
Earlier quoted context omitted.
There is a big difference between fun exercise and actually creating something that competes with the apps you can download. Building something on par with Claude Desktop, ChatGPT Desktop, etc. would be a lot of work. And I don't think the payoff would be there for most people.
Most people aren't hackers. Thanks to LLMs and vibe coding, even they can now take a can-do attitude to life that feels empowering. There's no longer any excuse to languish in helpless misery and negativity. You can just build things.
I've been on something of a quest to find a really good chat interface for LLMs. Most import feature for me is that I want to be able to chat with local models, remote models on my other machines, and cloud models (OpenAI API compatible). Anything that makes it easier to switch between models or query them simultaneously is important. Here's what I've learned so far: * Msty - my current favorite. Can do true simultan…
I've been building this: https://dinoki.ai/ Works fully local, privacy first, and it's a native app (Swift for macOS, WPF for Windows)