And why should anyone use it or ollama itself?
ollama is probably the easiest tool to use if you want to experiment with LLMs locally.
Ollama's new app
21–30 of 299 posts
Re: Ollama's new app
#22finally, what took so long lmao if im being honest i care more about multiple local ai apps on my desktop all hooking into the same ollama instance rather than all downloading their own models as part of the app so i have like multiple 10s of gbs of repeated weights all over the place because apps dont talk to each other what does it take for THAT to finally happen
That's already possible via the ollama API. It's up to applications themselves to support it (and plenty do).
Re: Ollama's new app
#23Boo. Dumb. Own the local backend. So much more to do there.
Trying to match the even larger local front end ecosystem is just a waste of energy.
Re: Ollama's new app
#24finally, what took so long lmao if im being honest i care more about multiple local ai apps on my desktop all hooking into the same ollama instance rather than all downloading their own models as part of the app so i have like multiple 10s of gbs of repeated weights all over the place because apps dont talk to each other what does it take for THAT to finally happen
symlinks
Re: Ollama's new app
#25I've been using Open WebUI and have been blown away, it's a better ChatGPT interface than ChatGPT! https://github.com/open-webui/open-webui Curious how this compares to that, which has a ton of features and runs great
Likewise. I use Ollama as the API server and CLI interface for local models, and use OpenWebUI when I want a web interface (which TBH, isn't that often) and it's a fine combination. Honestly, the idea of Ollama adding their own chat interface UI never even occurred to me. It feels a little bit... unnecessary?
Still choices are good, to props to the Ollama team!
Re: Ollama's new app
#26finally, what took so long lmao if im being honest i care more about multiple local ai apps on my desktop all hooking into the same ollama instance rather than all downloading their own models as part of the app so i have like multiple 10s of gbs of repeated weights all over the place because apps dont talk to each other what does it take for THAT to finally happen
I haven't used a local model in a while but ollama was the only one I've seen convert models into a different format. (I think for reduplication). You should be able to say download a gguf file and point a bunch of frontends to that same file.
Re: Ollama's new app
#27And why should anyone use it or ollama itself?
No one should use ollama. A cursory search of r/localllama gives plenty of occassions where they've proven themselves bad actors. Here's a 'fun' overview
https://www.reddit.com/r/LocalLLaMA/comments/1kg20mu/so_why_...
There are multiple (far better) options - eg LM studio if you want GUI, llama.cpp if you want the CLI that ollama ripped off. IMO the only reason ollama is even in the conversation is it was easy to get running on macOS, allowing the SV MBP set to feel included
Re: Ollama's new app
#28Re: Ollama's new app
#29Native or another electron crap?