Why not Linux? The UI looks to be some kind chrome based thingy - probably electron - should be easy to port to Linux. Also is there a link to the source?
Maybe the windows version runs under wine?
Ollama's new app
281–290 of 299 posts
Re: Ollama's new app
#282Earlier quoted context omitted.
do you know why ollama hasn't updated its models in over a month while many fantastic models have been released in that time, most recently GLM 4.5? It's forcing me to use LM Studio which I for whatever reason absolutely do not prefer. thank you guys for all your work on it, regardless
GLM 4.5 has a new/modified architecture. From what I understand, MLX was really one of the only frameworks that had support for it as of yesterday. LM Studio supports MLX as one backend. Everyone else was/is still developing support for it. Ollama has the new 235B and 30B Qwen3 models from this week, so it’s not as if they have done nothing for a month.
ah, that explains why all the GLM quants are MLX models
Re: Ollama's new app
#283Earlier quoted context omitted.
This. This. A thousand times this. I hate Windows / MacOS but love their desktops. I love Linux / BSD but hate their desktops. So my most expensive most powerful workstation is always a headless Linux machine that I ssh into from a Windows or MacOS toy computer. Unfortunately most developers do not understand this. Every time I run a command in the terminal and it tries to open a browser tab without printing the URL,…
Hey Justine! Thank you for all your fantastic work
Thanks!
Re: Ollama's new app
#284Looks like a big pivot on target audience from developers to regular users, at least on the homepage https://ollama.com/ as a product. Before, it was all about the CLI versions of Ollama for devs, now it's not even mentioned. At the bottom of the blog post it says: > For pure CLI versions of Ollama, standalone downloads are available on Ollama’s GitHub releases page. Nothing against that, just an observation. Previou…
one of the maintainers for Ollama. I don't see it as a pivot. We are all developers ourselves, and we use it. In fact, there are many self-made prototypes before this from different individuals. We were hooked, so we built it for ourselves. Ollama is made for developers, and our focus in continually improving Ollama's capabilities.
Thanks for including it. Ollama is very good at what it does. Including the feature is showing mindful growth in helping ollama be that skateboard, scooter, car, etc that the developer needs for LLM at that time. Making it appeal to casual/hobbyist is the right approach.
PS totally running windows here and using kesor/ollama-proxy if I need to make it externally available.
Re: Ollama's new app
#285Heads up, there’s a fair bit of pushback (justified or not) on r/LocalLLaMA about Ollama’s tactics: Vendor lock-in: AFAIK it now uses a proprietary llama.cpp fork and builts its own registry on ollama.com in a kind of docker way (I heard docker ppl are actually behind ollama) and it's a bit difficult to reuse model binaries with other inference engines due to their use of hashed filenames on disk etc. Closed-source t…
“I heard docker people are behind Ollama” um yes it’s founded by ex docker people and has raised multiple rounds of VC funding. The writing is on the wall - this is not some virtuous community project, it’s a profit driven startup and at the end of the day that is what they are optimizing for.
Re: Ollama's new app
#286[dead]
Re: Ollama's new app
#287Looks like a big pivot on target audience from developers to regular users, at least on the homepage https://ollama.com/ as a product. Before, it was all about the CLI versions of Ollama for devs, now it's not even mentioned. At the bottom of the blog post it says: > For pure CLI versions of Ollama, standalone downloads are available on Ollama’s GitHub releases page. Nothing against that, just an observation. Previou…
I think having a bash script as the linux installation is more of a stop-gap measure than truly supporting Linux. And ollama is FOSS compared to LM Studio and Msty (as someone who switched from ollama to LM Studio; I'm very happy to see the frontend development of ollama and an easier method of increasing the context length of a model).
lol the Ollama app is closed source
Re: Ollama's new app
#288Earlier quoted context omitted.
OpenWebUI is what you are looking for from a usability perspective. Supports many models chat.
Last I tried OpenWebUI (A few months ago), it was pretty painful to connect non-OpenAI externally hosted models. There was a workaround that involved installing a 3rd party "function" (or was it a "pipeline"?), but it didn't feel smooth. Is this easier now? Specifically, I would like to easily connect anthropic models just by plugging in my API key.
No, still the same, otoh, it works perfectly fine for Claude, and that is the only one I use. I just wished they would finally add native support for this ...
Re: Ollama's new app
#289Earlier quoted context omitted.
This is just wrong. Ollama has moved off of llama.cpp and is working with hardware partners to support GGML. https://ollama.com/blog/multimodal-models
is it? https://github.com/ollama/ollama/blob/main/llm/server.go#L79
we keep it for backwards compatibility - all the newer models are implemented inside Ollama directly
Re: Ollama's new app
#290I couldn't find the source for the new app, is it open source like the cli or is it rather closed?