Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ollama Turbo

ollama.com

Post reply on HN
Print view View original

71–80 of 251 posts

Re: Ollama Turbo

#71

Post by mchiang »

xiphias2 wrote: post #66
mchiang wrote: post #31

Earlier quoted context omitted.

we have always been building in the open, and so is Ollama. All the core pieces of Ollama are open. There are areas where we want to be opinionated on the design to build the world we want to see. There are areas we will make money, and I wholly believe if we follow our conscious we can create something amazing for the world while making sure we can keep it fueled to keep it going for the long term. Some of the ideas…

I wanted to try web search to increase my privacy but it wanted to do login. For Turbo mode I understand the need for paying but the main poing of running a local model with web search is browsing from my computer without using any LLM provider. Also I want to get rid of the latency to US servers from Europe. If ollama can't do it, maybe a fork.

login does not mean payment. It is free to use. It costs us to perform the web search, so we want to make sure it is not subject to abuse.

Re: Ollama Turbo

#72

Post by AndroTux »

jacekm wrote: post #63

What could be the benefit of paying $20 to Ollama to run inferior models instead of paying the same amount of money to e.g. OpenAI for access to sota models?

Privacy, I guess. But at this point it’s just believing that they won’t log your data.

Re: Ollama Turbo

#73

Post by daft_pink »

jacekm wrote: post #63

What could be the benefit of paying $20 to Ollama to run inferior models instead of paying the same amount of money to e.g. OpenAI for access to sota models?

I feel the primary benefit of this Ollama Turbo is that you can quickly test and run different models in the cloud that you could run locally if you had the correct hardware.

This allows you to try out some open models and better assess if you could buy a dgx box or Mac Studio with a lot of unified memory and build out what you want to do locally without actually investing in very expensive hardware.

Certain applications require good privacy control and on-prem and local are something certain financial/medical/law developers want. This allows you to build something and test it on non-private data and then drop in real local hardware later in the process.

Re: Ollama Turbo

#74

Post by [deleted] »

jacekm wrote: post #63

What could be the benefit of paying $20 to Ollama to run inferior models instead of paying the same amount of money to e.g. OpenAI for access to sota models?

[deleted]

Re: Ollama Turbo

#75

Post by ac29 »

timmg wrote: post #70

It says “usage-based pricing” is coming soon. I think that is the sweet spot for a service like this. I pay $20 to Anthropic, so I don’t think I’d get enough use out of this for the $20 fee. But being able to spin up any of these models and use as needed (and compare) seems extremely useful to me. I hope this works out well for the team.

> It says “usage-based pricing” is coming soon. I think that is the sweet spot for a service like this.

Agreed, though there are already several providers of these new OpenAI models available, so I'm not sure what ollama's value add is there (there are plenty of good chat/code/etc interfaces available if you are bringing your own API keys).

Re: Ollama Turbo

#76

Post by Philpax »

satvikpendem wrote: post #25
smlacy wrote: post #15

Watching ollama pivot from a somewhat scrappy yet amazingly important and well designed open source project to a regular "for-profit company" is going to be sad. Thankfully, this may just leave more room for other open source local inference engines.

> important and well designed open source project It was always just a wrapper around the real well designed OSS, llama.cpp. Ollama even messes up the names of models by calling distilled models the name of the actual one, such as DeepSeek. Ollama's engineers created Docker Desktop, and you can see how that turned out, so I don't have much faith in them to continue to stay open given what a rugpull Docker Desktop bec…

I wouldn't go as far as to say that llama.cpp is "well designed" (there be demons there), but I otherwise agree with the sentiment.

Re: Ollama Turbo

#77

Post by rapind »

jacekm wrote: post #63

What could be the benefit of paying $20 to Ollama to run inferior models instead of paying the same amount of money to e.g. OpenAI for access to sota models?

I'm not sure the major models will remain at $20. Regardless, I support any and all efforts to keep the space crowded and competitive.

Re: Ollama Turbo

#78

Post by michelsedgh »

jacekm wrote: post #63

What could be the benefit of paying $20 to Ollama to run inferior models instead of paying the same amount of money to e.g. OpenAI for access to sota models?

I think its the data privacy is the main point and probably more usage before you hit limits? But mainly data privacy i guess
Post reply on HN