It needs web search, because the smaller models often lack information.
Also a display of whether a model fits into vram would be nice.
Ollama's new app
201–210 of 299 posts
Re: Ollama's new app
#202Looks like a big pivot on target audience from developers to regular users, at least on the homepage https://ollama.com/ as a product. Before, it was all about the CLI versions of Ollama for devs, now it's not even mentioned. At the bottom of the blog post it says: > For pure CLI versions of Ollama, standalone downloads are available on Ollama’s GitHub releases page. Nothing against that, just an observation. Previou…
one of the maintainers for Ollama. I don't see it as a pivot. We are all developers ourselves, and we use it. In fact, there are many self-made prototypes before this from different individuals. We were hooked, so we built it for ourselves. Ollama is made for developers, and our focus in continually improving Ollama's capabilities.
Does the new app make it easier for users to expose the Ollama daemon on the network (and mdns discovery )? It’s still trickier than needed for Home Assistant users to get started with Ollama (which tends to run on a different machine).
Re: Ollama's new app
#203Earlier quoted context omitted.
This. This. A thousand times this. I hate Windows / MacOS but love their desktops. I love Linux / BSD but hate their desktops. So my most expensive most powerful workstation is always a headless Linux machine that I ssh into from a Windows or MacOS toy computer. Unfortunately most developers do not understand this. Every time I run a command in the terminal and it tries to open a browser tab without printing the URL,…
I can recommend to spend a day finding and configuring a window manager that suits your needs.
I doubt that she spent the time to create a cross platform C compiler library but didn't bother trying out a few Linux desktops.
Re: Ollama's new app
#204If you’re a power user of these LLMs and have coding experience, I actually recommend just whipping together your own bespoke chat UI that you can customize however you like. Grab any OpenAI compatible endpoint for inference and a frontend component framework (many of which have added standard Chat components) - the rest is almost trivial. I threw one together in a week with Gemini’s assistance and now I use it every…
Yes I do that too. The important bit is the model. Rest is almost trivial. I had posted a Show HN here about the script I've been using which is open source now ( https://github.com/n-k/tinycoder ) ( https://news.ycombinator.com/item?id=44674856 ). With a bit of help from ChatGPT etc., it was trivial to make, and I use it everyday now. I may add DDG and github search to it soon too.
this is not coder
this help typing instructions. Coding is different. For example look at my repository and tell me how refactorizing it, write a new function etc.
In my opinion You must change name.
Re: Ollama's new app
#205Re: Ollama's new app
#206There's also Jan AI, which supports Linux, MCP, any Vulkan GPU, any Llama.cpp-compatible model, and optionally multiple cloud models as well. That seems like a better solution than this.
Choice is good but here is why prefer Ollama over others (I'm biased because I work on Ollama). Supporting multiple backends is HARD. Originally, we thought we'd just add multiple backends to Ollama - MLX, ROCm, TRT-LLM, etc. It sounds really good on paper. In practice, you get into the lowest common denominator effect. What happens when you want to release Model A together with the model creator, and backend B doesn…
GPUStack doesn't seem to have the problem of lowest common denominator but supports many architectures.
Re: Ollama's new app
#207I've been on something of a quest to find a really good chat interface for LLMs. Most import feature for me is that I want to be able to chat with local models, remote models on my other machines, and cloud models (OpenAI API compatible). Anything that makes it easier to switch between models or query them simultaneously is important. Here's what I've learned so far: * Msty - my current favorite. Can do true simultan…
CherryStudio is a power tool for this case https://github.com/CherryHQ/cherry-studio -- has MCP, search, personas, and reasoning support too. i use it heavily with llama.cpp + llama-swap
Have fun on their Issues page if you don't read and write Chinese. Documentation pages are written in Chinese as well.
Re: Ollama's new app
#208Earlier quoted context omitted.
one of the maintainers for Ollama. I don't see it as a pivot. We are all developers ourselves, and we use it. In fact, there are many self-made prototypes before this from different individuals. We were hooked, so we built it for ourselves. Ollama is made for developers, and our focus in continually improving Ollama's capabilities.
Does the new app make it easier for users to expose the Ollama daemon on the network (and mdns discovery )? It’s still trickier than needed for Home Assistant users to get started with Ollama (which tends to run on a different machine).
There's a simple toggle for juet that.
Re: Ollama's new app
#209Earlier quoted context omitted.
But you can build something new instead of reinventing the wheel for the thousandth time.
I've only been lucky enough to find one opportunity in my entire twenty-seven year career to write something novel and new. Most of the time we're reinventing the wheel. What separates the winners from the losers is whether or not it's your wheel.
I don't know, you don't have to invent cosmopolitan libc to qualify as new, but my bar is higher than another LLM chat app.
Then again, maybe OP's app will have some new twist that will revolutionise everything.
Re: Ollama's new app
#210Earlier quoted context omitted.
one of the maintainers for Ollama. I don't see it as a pivot. We are all developers ourselves, and we use it. In fact, there are many self-made prototypes before this from different individuals. We were hooked, so we built it for ourselves. Ollama is made for developers, and our focus in continually improving Ollama's capabilities.
Does the new app make it easier for users to expose the Ollama daemon on the network (and mdns discovery )? It’s still trickier than needed for Home Assistant users to get started with Ollama (which tends to run on a different machine).
In the app settings now, there is a toggle for "Expose Ollama to the network" - it allows for other devices or services on the network to access Ollama.