If these are FP4 like the other ollama models then I'm not very interested. If I'm using an API anyway I'd rather use the full weights.
Ollama Turbo
101–110 of 251 posts
Re: Ollama Turbo
#102Watching ollama pivot from a somewhat scrappy yet amazingly important and well designed open source project to a regular "for-profit company" is going to be sad. Thankfully, this may just leave more room for other open source local inference engines.
we have always been building in the open, and so is Ollama. All the core pieces of Ollama are open. There are areas where we want to be opinionated on the design to build the world we want to see. There are areas we will make money, and I wholly believe if we follow our conscious we can create something amazing for the world while making sure we can keep it fueled to keep it going for the long term. Some of the ideas…
I'm sorry but your words don't match your actions.
Re: Ollama Turbo
#103Called it. It's very unfortunate that the local inference community has aggregated around Ollama when it's clear that's not their long term priority or strategy. Its imperative we move away ASAP
Oh no this is a positively diabolical development, offering...hosting services tailored to a specific use case at a reasonable price ...
Re: Ollama Turbo
#104If these are FP4 like the other ollama models then I'm not very interested. If I'm using an API anyway I'd rather use the full weights.
OpenAI has only provided MXFP4 weights. These are the same weights used by other cloud providers.
Re: Ollama Turbo
#105Called it. It's very unfortunate that the local inference community has aggregated around Ollama when it's clear that's not their long term priority or strategy. Its imperative we move away ASAP
Yes, better to get free sh*t unsustainably. By the way, you're free to create an open source alternative and pour your time into that so we can all benefit. But when you don't — remember I called it!
Re: Ollama Turbo
#106Called it. It's very unfortunate that the local inference community has aggregated around Ollama when it's clear that's not their long term priority or strategy. Its imperative we move away ASAP
Llama.cpp (library which ollama uses under the hoods) has its own server, and it is fully compatible with open-webui.
I moved away from ollama in favor of llama-server a couple of months ago and never missed anything, since I'm still using the same UI.
Re: Ollama Turbo
#107Re: Ollama Turbo
#108Re: Ollama Turbo
#109I am so so so confused as to why Ollama of all companies did this other than an emblematic stab at making money-perhaps to appease someone putting pressure on them to do so. Their stuff does a wonderful job of enabling local for those who want it. So many things to explore there but instead they stand up yet another cloud thing? Love Ollama and hope it stays awesome
Re: Ollama Turbo
#110Called it. It's very unfortunate that the local inference community has aggregated around Ollama when it's clear that's not their long term priority or strategy. Its imperative we move away ASAP
Huggingface also offers a cloud product, but that doesn’t take away from downloading weights and running them locally.