Live data from Hacker News

Why is Chat GPT so expensive to operate?

news.ycombinator.com

51–54 of 54 posts

Re: Why is Chat GPT so expensive to operate?

#51
post #47
post #39

Earlier quoted context omitted.

> It onlu works if there are always a high rate of survivors There doesn't have to be a high rate of survival if the reproductive rate compensates for losses. E.g., if 80% of wild rabbits are eaten, but the remaining 20% can give birth to 5 bunnies per parent per lifetime, the population will be stable. I have no idea where you're getting your beliefs, but most of it is wrong in both the math and biology.

What I am saying is that rate needs to continue to be positive and out of 20% survivors many will not carry the survival gene. And on top of that, it isn't just one thing that kills a rabbit in your example, the climate, not finding mates, predators, disease and more all must be overcome at once. Survivors must overcome a wide array of adversity and succesfully pass on that combination of abilities and this needs to…

Yet creatures survive and reproduce, the fact that you can observe, analyze and even control.

I think you’re ignoring a bunch of dynamics by trying to model it with binary.

Prey population going down means a predator population also going down and a competitor population going up. It’s not an endgame, it’s just an “ear” of a very complex attractor, which with time only sharpens it ability to have as little escape points as possible.

1°C fluctuation by itself does nothing, because life usually has much wider tolerance due to long seasonal fluctuations. A global +-degree means there will be a tipping point somewhere which would bring a local drastic change. Locally life may suffer, but it counteracts with migration and preexisting diversity. It simply suffers everywhere, always. It’s a modus operandi. A little bit more is barely fatal.

So yes, survival is the default because life naturally specializes in it.

Re: Why is Chat GPT so expensive to operate?

#52

I think it's actually quite cheap for what it is

what useful purpose have you found for ChatGPT given the “it can return inaccurate results posed as accurate” problem?

It does coding things extremely well. Are there some errors here or there at times? Yes but in general it does it excellently. I think this is a good example of not letting the perfect be the enemy of the good.

It will write 200 lines of code for me which would maybe take me a few hours. I have to spend 15 minutes cleaning it up, but still it saved me 80% of the time. It's a massive win.

Also great for writing articles, or emails. I write what I want to say into ChatGPT and tell it to state rewrite it to be pleasant and less harsh and it does a great job of that.

Re: Why is Chat GPT so expensive to operate?

#53
Because its a language model and really does not query information but assumes relationships with them. Meaning that "the words" have to be encoded and brought into relation by text.

Now there are different ways to achieve this, but in essence because it has to know everything all at once plus instructions on how to handle that.

You can actually ask it to explain to you how you could create a natural language processing algorithm yourself and it will even give you a starter framework in the language of your choice. But a fair warning, for me it was like a 6 hour deep rabbit hole :D

Post reply on HN