Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ollama's new app

ollama.com

Post reply on HN
Print view View original

231–240 of 299 posts

Re: Ollama's new app

#231

Post by jay_kyburz »

jeffhuys wrote: post #194
jay_kyburz wrote: post #118

OK, for those interested, I have a Ryzen9 2700 with a 12GB RX6750XT and downloaded Gemma3:4b because that was what the app suggested first. The speed seems fine to me, but the hallucinations are wild, completely wrong on a few things I like to test the commercial offerings on. For simple questions about the lua language and how to do things in Unity game engine the results look fairly OK.

Honestly to be expected with a 4b model. 12b/14b+ is the minimum in my experience to get decent results, unless you have a specific use-case for the 4b ones and fine-tune it to your use.

Yeah, I tried Deepseek 8b as well and it was hopeless, but it was interesting to watch it think. I haven't seen that before.

Re: Ollama's new app

#232

Post by [deleted] »

flux293m wrote: post #218
mchiang wrote: post #54

Earlier quoted context omitted.

one of the maintainers for Ollama. I don't see it as a pivot. We are all developers ourselves, and we use it. In fact, there are many self-made prototypes before this from different individuals. We were hooked, so we built it for ourselves. Ollama is made for developers, and our focus in continually improving Ollama's capabilities.

Congratulations on launching the front-end, but I don't see how it can be made for developers and not have a Linux version.

[deleted]

Re: Ollama's new app

#233

Post by [deleted] »

amelius wrote: post #184
jart wrote: post #136

Earlier quoted context omitted.

This. This. A thousand times this. I hate Windows / MacOS but love their desktops. I love Linux / BSD but hate their desktops. So my most expensive most powerful workstation is always a headless Linux machine that I ssh into from a Windows or MacOS toy computer. Unfortunately most developers do not understand this. Every time I run a command in the terminal and it tries to open a browser tab without printing the URL,…

I can recommend to spend a day finding and configuring a window manager that suits your needs.

[deleted]

Re: Ollama's new app

#234

Post by ojosilva »

apitman wrote: post #38

I've been on something of a quest to find a really good chat interface for LLMs. Most import feature for me is that I want to be able to chat with local models, remote models on my other machines, and cloud models (OpenAI API compatible). Anything that makes it easier to switch between models or query them simultaneously is important. Here's what I've learned so far: * Msty - my current favorite. Can do true simultan…

I've been in the same quest for a while. Here's my list, not a recommendation or endorsement list, just a list of alternative clients I've considered, tried or am still evaluating:

- chatbox - https://github.com/chatboxai/chatbox - free and OSS, with a paid tier, supports MCP and local/remote, has a local KB, works well so far and looks promising.

- macai - https://github.com/Renset/macai simple client for remote APIs, does not support image pasting or MCP or anything really, very limited, crashes.

- typingmind.com - web, with a downloadable (if paid) version. Not OSS, but one-time payment, indie dev. One of the first alt chat clients I've ever tried, not using it anymore. Somewhat clunky gui, but ok. Supports MCP, haven't tried it it.

- Open WebUI - deployed for our team so that we could chat through many APIs. Works well for a multi-user web-deployment, but image generation hasn't been working. I don't like it as a personal client though, buggy sometimes but gets frequent fixes fortunately.

- jan.ai - it comes with popular models pre-populated listed, which makes it harder to plug into custom or local model servers. But it supports local model deployment within the app (like what ollama is announcing) which is good for people who don't want to deal with starting a server. I haven't played with it enough, but I personally prefer to deploy a local server (ie ollama, litellm...) and then just have the chat gui app give me a flexible endpoint configuration for adding custom models to it.

I'm also wary of evil actors deploying chat GUIs just to farm your API keys. You should be too. Use disposable api keys, watch usage, refresh with new keys once in a while after trying clients.

Re: Ollama's new app

#235

Post by nocommandline »

pzo wrote: post #125
pentagrama wrote: post #44

Looks like a big pivot on target audience from developers to regular users, at least on the homepage https://ollama.com/ as a product. Before, it was all about the CLI versions of Ollama for devs, now it's not even mentioned. At the bottom of the blog post it says: > For pure CLI versions of Ollama, standalone downloads are available on Ollama’s GitHub releases page. Nothing against that, just an observation. Previou…

this is actually positive even for devs. The more users have ollama installed then you can release some desktop ai app for them and don't have to bundle additional models in your own app. Easier to provide to such user free or cheaper subscription because you don't have additional costs. Latest Qwen30B models area really powerful. Would be even better if there was a installation template that checks if Ollama is inst…

> Would be even better if there was a installation template that checks if Ollama is installed and if not download it as sub installation first..... Also API to prompt user (ask for permission) to install specific model if haven't been installed.

That's actually what we've done for our own App [1]. It checks if Ollama and other dependencies are installed. No model is bundled with it. We prompt user to install a model (you pick a model, click a button and we download the model; similar if you wish to remove a model). The aim is to make it quite simple for non-technical folks to use.

1) https://ai.nocommandline.com/

Re: Ollama's new app

#236

Post by evgen »

apitman wrote: post #137
HumanOstrich wrote: post #71

Earlier quoted context omitted.

LM Studio is for hosting/serving local LLMs. Its chat UI is secondary and is pretty limited.

Good to know, thanks. What do people generally use to connect to it for chat?

OpenWebUI seems to be the standard. Easy to spin it up in a docker container pointed to 127.0.0.1:1234/v1 and away you go.

Re: Ollama's new app

#237

Post by btreecat »

mchiang wrote: post #54
pentagrama wrote: post #44

Looks like a big pivot on target audience from developers to regular users, at least on the homepage https://ollama.com/ as a product. Before, it was all about the CLI versions of Ollama for devs, now it's not even mentioned. At the bottom of the blog post it says: > For pure CLI versions of Ollama, standalone downloads are available on Ollama’s GitHub releases page. Nothing against that, just an observation. Previou…

one of the maintainers for Ollama. I don't see it as a pivot. We are all developers ourselves, and we use it. In fact, there are many self-made prototypes before this from different individuals. We were hooked, so we built it for ourselves. Ollama is made for developers, and our focus in continually improving Ollama's capabilities.

Congratulations on the next release.

I really like using ollama as a backend to OpenWebUI.

I don't have any windows machines and I don't work primarily on macos, but I understand that's where all the paying developers are, in theory.

Did y'all consider a partnership with one of the existing UI and bundle that, similar to duckdb approach?

Re: Ollama's new app

#238

Post by rpastuszak »

btreecat wrote: post #237
mchiang wrote: post #54

Earlier quoted context omitted.

one of the maintainers for Ollama. I don't see it as a pivot. We are all developers ourselves, and we use it. In fact, there are many self-made prototypes before this from different individuals. We were hooked, so we built it for ourselves. Ollama is made for developers, and our focus in continually improving Ollama's capabilities.

Congratulations on the next release. I really like using ollama as a backend to OpenWebUI. I don't have any windows machines and I don't work primarily on macos, but I understand that's where all the paying developers are, in theory. Did y'all consider a partnership with one of the existing UI and bundle that, similar to duckdb approach?

I’m just curious because I don’t use Ollama and have some spare vram: How do you use it and what models do you use?

Re: Ollama's new app

#239

Post by FergusArgyll »

thorum wrote: post #97

If you’re a power user of these LLMs and have coding experience, I actually recommend just whipping together your own bespoke chat UI that you can customize however you like. Grab any OpenAI compatible endpoint for inference and a frontend component framework (many of which have added standard Chat components) - the rest is almost trivial. I threw one together in a week with Gemini’s assistance and now I use it every…

Yeah, I have one which lets me read a pdf and chat side by side, one which is integrated into my rss feed, one with insanely aggressive memory features (experimental) etc etc :)

Re: Ollama's new app

#240

Post by VagabundoP »

mchiang wrote: post #215
ozim wrote: post #212

Earlier quoted context omitted.

I just updated and a bit annoying by default gemma3:4b was selected that I don't have on my local. I guess would be nicer to default to one of the models that are present. It was nice it started downloading it but also there was no indication I don't have that model before hand until I opened drop-down to see download buttons. But of course nice job guys.

Thanks for the kind words. Sorry about that, we are working out some of the initial experience for Ollama.

Big thanks to you and your team for this. My first time tying offline models, will the github cli use the same models by default (MacOS)?
Post reply on HN