Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ollama's new app

ollama.com

Post reply on HN
Print view View original

191–200 of 299 posts

Re: Ollama's new app

#191

Post by graemep »

1dom wrote: post #188

I don't understand this move. A frontend desktop application is the opposite of what I and anyone else I know uses Ollama for. It's a local LLM backend. It's been around long enough now that any long term users have found, created and/or adjusted to their own front end interface. I'm comfy, but some of the cutting edge local LLMs have been a little bit slow to be available recently, maybe this frontend focus is why.…

There are many GUIs for Ollama.

This looks like a version of Ollama that bundles one.

Re: Ollama's new app

#192

Post by teekert »

apitman wrote: post #38

I've been on something of a quest to find a really good chat interface for LLMs. Most import feature for me is that I want to be able to chat with local models, remote models on my other machines, and cloud models (OpenAI API compatible). Anything that makes it easier to switch between models or query them simultaneously is important. Here's what I've learned so far: * Msty - my current favorite. Can do true simultan…

I like webUI but it’s weird and conplicated how you have to set up the different models (via text files in the browser, the instructions contains a lot of confusing terms). Librechat is nice but I can’t get it to not log me out every 5 min which makes it unusable. I’ve been told it keeps you logged in when using https but I use tailscale so that is difficult (when doing multiple services on a single host).

Re: Ollama's new app

#193

Post by graemep »

amelius wrote: post #184
jart wrote: post #136

Earlier quoted context omitted.

This. This. A thousand times this. I hate Windows / MacOS but love their desktops. I love Linux / BSD but hate their desktops. So my most expensive most powerful workstation is always a headless Linux machine that I ssh into from a Windows or MacOS toy computer. Unfortunately most developers do not understand this. Every time I run a command in the terminal and it tries to open a browser tab without printing the URL,…

I can recommend to spend a day finding and configuring a window manager that suits your needs.

This was my thought. Given the huge range of desktop environments and window managers available there has to be one that suits you.

Probably one that suits you pretty much out of the box.

Re: Ollama's new app

#194

Post by jeffhuys »

jay_kyburz wrote: post #118

OK, for those interested, I have a Ryzen9 2700 with a 12GB RX6750XT and downloaded Gemma3:4b because that was what the app suggested first. The speed seems fine to me, but the hallucinations are wild, completely wrong on a few things I like to test the commercial offerings on. For simple questions about the lua language and how to do things in Unity game engine the results look fairly OK.

Honestly to be expected with a 4b model. 12b/14b+ is the minimum in my experience to get decent results, unless you have a specific use-case for the 4b ones and fine-tune it to your use.

Re: Ollama's new app

#195

Post by gen2brain »

pjmlp wrote: post #172
nguyenkien wrote: post #88

Earlier quoted context omitted.

Also, this is not electron app. It does use system webview thought.

At least that is already an improvement, away from ChromeOS Development Platform.

If I already have to use a bundled web app, I prefer Electron. My system doesn't have a "system webview"; I don't have webkit-gtk installed/compiled.

Re: Ollama's new app

#197

Post by mchiang »

1dom wrote: post #188

I don't understand this move. A frontend desktop application is the opposite of what I and anyone else I know uses Ollama for. It's a local LLM backend. It's been around long enough now that any long term users have found, created and/or adjusted to their own front end interface. I'm comfy, but some of the cutting edge local LLMs have been a little bit slow to be available recently, maybe this frontend focus is why.…

Rightful worry, and we had the same doubts before we embarked on this. Ollama serves developers, there is no doubt about that. The CLI isn’t getting dropped, in fact, what we’ve learned in building it is having the interface interacting with Ollama is a great way for us to dogfood Ollama while building it.

There are so many choices for having an interface, and as a developer you should have a choice in selecting the UI you want. It will all continue to work with Ollama. Nothing about that changes.

Re: Ollama's new app

#199

Post by mchiang »

coder543 wrote: post #95

I am somewhat surprised that this app doesn't seem to offer any way to connect to a remote Ollama instance. The most powerful computer I own isn't necessarily the one I'm running the GUI on.

This is a feature we are looking into supporting. Thank you for reaffirming the need.

Re: Ollama's new app

#200

Post by pjmlp »

gen2brain wrote: post #195
pjmlp wrote: post #172

Earlier quoted context omitted.

At least that is already an improvement, away from ChromeOS Development Platform.

If I already have to use a bundled web app, I prefer Electron. My system doesn't have a "system webview"; I don't have webkit-gtk installed/compiled.

If I have to use a Web app, I prefer a server URL.
Post reply on HN