Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ollama Turbo

ollama.com

Post reply on HN
Print view View original

11–20 of 251 posts

Re: Ollama Turbo

#11

Post by webdevver »

moralestapia wrote: post #8
freedomben wrote: post #6

Earlier quoted context omitted.

Is Georgi landing any of those big-time money jobs? I could see a conflict-of-interest given his involvment with llama.cpp, but I would think he'd be well positioned for something like that

(This is mere speculation) I think he's happy doing his own thing. But then, if someone came in with a billion ... who wouldn't give it a thought?

really a billion bucks is far too much, that is beyond the curve.

$50M, now thats just perfect. you're retired, nor burdened with a huge responsibility

Re: Ollama Turbo

#12

Post by satellite2 »

"All hardware is located in the United States."

If I use local/OSS models it's specifically to avoid running in a country with no data protection laws. It's a big close miss here.

Re: Ollama Turbo

#13

Post by polarbear67 »

Why does everything AI-related have to be $20? Why can't there be tiers? OpenAI setting the standard of $20/m for every AI application is one of the worst things to ever happen.

Re: Ollama Turbo

#14

Post by rafram »

mrs6969 wrote: post #9
moralestapia wrote: post #5

Ollama is great but I feel like Georgi Gerganov deserves way more credit for llama.cpp. He (almost) single-handedly brought LLMs to the masses. With the latest news of some AI engineers' compensation reaching up to a billion dollars, feels a bit unfair that Georgi is not getting a much larger slice of the pie.

Agreed. Ollama itself is kind a wrapper around llamacpp anyway. Feel like the real guy is not included to the process. Now I am going to go and write a wrapper around llamacpp, that is only open source, truly local. How can I trust ollama to not to sell my data.

Ollama is not a wrapper around llama.cpp anymore, at least for multimodal models (not sure about others). They have their own engine: https://ollama.com/blog/multimodal-models

Re: Ollama Turbo

#15

Post by smlacy »

Watching ollama pivot from a somewhat scrappy yet amazingly important and well designed open source project to a regular "for-profit company" is going to be sad.

Thankfully, this may just leave more room for other open source local inference engines.

Re: Ollama Turbo

#16

Post by Patrick_Devine »

mrs6969 wrote: post #9
moralestapia wrote: post #5

Ollama is great but I feel like Georgi Gerganov deserves way more credit for llama.cpp. He (almost) single-handedly brought LLMs to the masses. With the latest news of some AI engineers' compensation reaching up to a billion dollars, feels a bit unfair that Georgi is not getting a much larger slice of the pie.

Agreed. Ollama itself is kind a wrapper around llamacpp anyway. Feel like the real guy is not included to the process. Now I am going to go and write a wrapper around llamacpp, that is only open source, truly local. How can I trust ollama to not to sell my data.

Ollama only uses llamacpp for running legacy models. gpt-oss runs entirely in the ollama engine.

You don't need to use Turbo mode; it's just there for people who don't have capable enough GPUs.

Re: Ollama Turbo

#17

Post by apwell23 »

freedomben wrote: post #6
moralestapia wrote: post #5

Ollama is great but I feel like Georgi Gerganov deserves way more credit for llama.cpp. He (almost) single-handedly brought LLMs to the masses. With the latest news of some AI engineers' compensation reaching up to a billion dollars, feels a bit unfair that Georgi is not getting a much larger slice of the pie.

Is Georgi landing any of those big-time money jobs? I could see a conflict-of-interest given his involvment with llama.cpp, but I would think he'd be well positioned for something like that

https://ggml.ai/

> ggml.ai is a company founded by Georgi Gerganov to support the development of ggml. Nat Friedman and Daniel Gross provided the pre-seed funding.

Re: Ollama Turbo

#18

Post by thimabi »

polarbear67 wrote: post #13

Why does everything AI-related have to be $20? Why can't there be tiers? OpenAI setting the standard of $20/m for every AI application is one of the worst things to ever happen.

My guess is that’s the lowest price point that provides a modicum of profitability — LLMs are quite expensive to run, and even more so for providers like Ollama, which are entering the market and don’t have idle capacity.

Re: Ollama Turbo

#20

Post by user- »

smlacy wrote: post #15

Watching ollama pivot from a somewhat scrappy yet amazingly important and well designed open source project to a regular "for-profit company" is going to be sad. Thankfully, this may just leave more room for other open source local inference engines.

I remember them pivoting from being infra.hq
Post reply on HN