Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ollama's new app

ollama.com

Post reply on HN
Print view View original

121–130 of 299 posts

Re: Ollama's new app

#121

Post by n_kr »

thorum wrote: post #97

If you’re a power user of these LLMs and have coding experience, I actually recommend just whipping together your own bespoke chat UI that you can customize however you like. Grab any OpenAI compatible endpoint for inference and a frontend component framework (many of which have added standard Chat components) - the rest is almost trivial. I threw one together in a week with Gemini’s assistance and now I use it every…

Yes I do that too. The important bit is the model. Rest is almost trivial. I had posted a Show HN here about the script I've been using which is open source now ( https://github.com/n-k/tinycoder ) ( https://news.ycombinator.com/item?id=44674856 ).

With a bit of help from ChatGPT etc., it was trivial to make, and I use it everyday now. I may add DDG and github search to it soon too.

Re: Ollama's new app

#122

Post by n_kr »

pmarreck wrote: post #102
thorum wrote: post #97

If you’re a power user of these LLMs and have coding experience, I actually recommend just whipping together your own bespoke chat UI that you can customize however you like. Grab any OpenAI compatible endpoint for inference and a frontend component framework (many of which have added standard Chat components) - the rest is almost trivial. I threw one together in a week with Gemini’s assistance and now I use it every…

[flagged]

I have a 1yo too, and I could do it. I used the other tools to make one which I liked.

Re: Ollama's new app

#123

Post by vismit2000 »

IceWreck wrote: post #4

Why not Linux? The UI looks to be some kind chrome based thingy - probably electron - should be easy to port to Linux. Also is there a link to the source?

I believe power users or developers can already use this from CLI in Linux. This new app for Windows and MacOS shows this is intended for regular users.

Re: Ollama's new app

#124

Post by vinhnx »

thorum wrote: post #97

If you’re a power user of these LLMs and have coding experience, I actually recommend just whipping together your own bespoke chat UI that you can customize however you like. Grab any OpenAI compatible endpoint for inference and a frontend component framework (many of which have added standard Chat components) - the rest is almost trivial. I threw one together in a week with Gemini’s assistance and now I use it every…

I have been exploring AI and LLMs. I built my own AI chat bot using Python [1], and then [2] AI SDK from Vercel and OpenAI compatible API endpoints. And eventually build a product around it.

1. VT.ai https://github.com/vinhnx/VT.ai Python

2. VT Chat https://vtchat.io.vn: my own product

Re: Ollama's new app

#125

Post by pzo »

pentagrama wrote: post #44

Looks like a big pivot on target audience from developers to regular users, at least on the homepage https://ollama.com/ as a product. Before, it was all about the CLI versions of Ollama for devs, now it's not even mentioned. At the bottom of the blog post it says: > For pure CLI versions of Ollama, standalone downloads are available on Ollama’s GitHub releases page. Nothing against that, just an observation. Previou…

this is actually positive even for devs. The more users have ollama installed then you can release some desktop ai app for them and don't have to bundle additional models in your own app. Easier to provide to such user free or cheaper subscription because you don't have additional costs. Latest Qwen30B models area really powerful.

Would be even better if there was a installation template that checks if Ollama is installed and if not download it as sub installation first checking user computer specs if enough RAM and fast enough CPU/GPU. Also API to prompt user (ask for permission) to install specific model if haven't been installed.

Re: Ollama's new app

#126

Post by nileshtrivedi »

mchiang wrote: post #54
pentagrama wrote: post #44

Looks like a big pivot on target audience from developers to regular users, at least on the homepage https://ollama.com/ as a product. Before, it was all about the CLI versions of Ollama for devs, now it's not even mentioned. At the bottom of the blog post it says: > For pure CLI versions of Ollama, standalone downloads are available on Ollama’s GitHub releases page. Nothing against that, just an observation. Previou…

one of the maintainers for Ollama. I don't see it as a pivot. We are all developers ourselves, and we use it. In fact, there are many self-made prototypes before this from different individuals. We were hooked, so we built it for ourselves. Ollama is made for developers, and our focus in continually improving Ollama's capabilities.

Question since you are here, how long before tool-calling is enabled for Gemma3 models?

Re: Ollama's new app

#127

Post by Petersipoi »

ellg wrote: post #115
bapak wrote: post #113

Earlier quoted context omitted.

This is the most "just build your own Linux" comment I read this year. Just download some tool and be productive within seconds, I'd say.

Kinda odd to be so dismissive of this mindset given this websites title. Whipping up your own chatui really is not that hard and is a pretty fun exercise. Knowing how your tools work and being able to tweak them to your specific usecases kinda rules!

There is a big difference between fun exercise and actually creating something that competes with the apps you can download. Building something on par with Claude Desktop, ChatGPT Desktop, etc. would be a lot of work. And I don't think the payoff would be there for most people.

Re: Ollama's new app

#129

Post by _boffin_ »

nileshtrivedi wrote: post #126
mchiang wrote: post #54

Earlier quoted context omitted.

one of the maintainers for Ollama. I don't see it as a pivot. We are all developers ourselves, and we use it. In fact, there are many self-made prototypes before this from different individuals. We were hooked, so we built it for ourselves. Ollama is made for developers, and our focus in continually improving Ollama's capabilities.

Question since you are here, how long before tool-calling is enabled for Gemma3 models?

You can do “tool calling” via Gemma3. The issue is that it all needs to be stuck in the user prompt as there’s no system prompt

Re: Ollama's new app

#130

Post by _boffin_ »

pmarreck wrote: post #103
mchiang wrote: post #54

Earlier quoted context omitted.

one of the maintainers for Ollama. I don't see it as a pivot. We are all developers ourselves, and we use it. In fact, there are many self-made prototypes before this from different individuals. We were hooked, so we built it for ourselves. Ollama is made for developers, and our focus in continually improving Ollama's capabilities.

do you know why ollama hasn't updated its models in over a month while many fantastic models have been released in that time, most recently GLM 4.5? It's forcing me to use LM Studio which I for whatever reason absolutely do not prefer. thank you guys for all your work on it, regardless

You know that if you go to hugging face and find a gguf page, you can click on Deploy and select ollama. It comes with “run” but whatever—just change to pull. Has a jacked name, but works.

Also, if you search on ollama’s models, you’ll see user ones that you can download too

Post reply on HN