Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT4 is up to 6 times more expensive than GPT3.5

openai.com

Post reply on HN
Print view View original

31–40 of 136 posts

Re: GPT4 is up to 6 times more expensive than GPT3.5

#31

Post by sebzim4500 »

behnamoh wrote: post #27
obblekk wrote: post #9

Worth remembering GPT3 was 10-20 times more expensive 2yrs ago. There's a super-moore's law type learning function going on here and I suspect in 1yr GPT4.5 will be the same cost as GPT3.5 today. It's insane... feels like iPhone 3G to iPhone 4 level quality improvement every year.

That's incorrect information. The original GPT3 price was about x3 times its current price, not 10-20 times. https://the-decoder.com/openai-cuts-prices-for-gpt-3-by-two-...

I think he means it was 30x more than gpt-3.5 is today.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#32

Post by wetpaws »

nonfamous wrote: post #15
Mizza wrote: post #13

Does anybody have their hands on it? Is it actually 6 times better at performing tasks, or are we paying more for improved corporate-friendly bumper bowling?

If you've used Bing Chat, you've used GPT-4: https://blogs.bing.com/search/march_2023/Confirmed-the-new-B...

heavily lobotomized version of GPT-4

Re: GPT4 is up to 6 times more expensive than GPT3.5

#33

Post by kenjackson »

Mizza wrote: post #24
simonw wrote: post #14

Earlier quoted context omitted.

Not the API, but if you pay for ChatGPT Plus you can try it out there. It's very, very impressive so far - I've tried a bunch of things I've previously run against GPT-3 and got noticeably better results - maybe not a 2x or 6x multiple in "quality" (depending on how you measure that) but still very clearly improved. Posted a few examples here: https://fedi.simonwillison.net/@simon/110022949941148725

Thanks for the reply. I'm not all that impressed by "what is"/information retrieval tasks, is it any better at "thought" tasks like explanatory reasoning and ideogensis? For instance - "How might an agoraphobic kleptomaniac satisfy both of their desires simultaneously?"

That's a tough question even for me. The answer it did give me was to steal something online. Which was better than anything I was thinking. What did you have in mind?

Re: GPT4 is up to 6 times more expensive than GPT3.5

#34

Post by speedgoose »

Maxion wrote: post #28
obblekk wrote: post #9

Worth remembering GPT3 was 10-20 times more expensive 2yrs ago. There's a super-moore's law type learning function going on here and I suspect in 1yr GPT4.5 will be the same cost as GPT3.5 today. It's insane... feels like iPhone 3G to iPhone 4 level quality improvement every year.

GPT-4 is a scary improvement over 3.5, especially for handling code. It will be the literal definition of awesome when these models get a large enough context space to hold a small-medium sized codebase. I've been playing around with it for an hour seeing what it can do to refactor some of the things we have with the most tech debt, and it is astounding how well it does with how little context I give it.

The 32k tokens version should do fairly well on such codebase. I don’t know if it’s the one used in ChatGPT.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#35

Post by sebzim4500 »

icapybara wrote: post #11
lewdev wrote: post #2

And website still says "openai."

Should they not be able to make money off a world changing new technology they bet billions on? Does your company offer all its products for free?

I think it was borderline defensible for them to not release the weights, but now they aren't even telling people the size of the model.

From their website:

>Our mission is to ensure that artificial general intelligence benefits all of humanity

Re: GPT4 is up to 6 times more expensive than GPT3.5

#36

Post by jazzyjackson »

Veen wrote: post #16

I imagine this price will come down over time. OpenAI has repeatedly said that they haven't the infrastructure in place yet to handle too much load and expect to be "severely capacity constrained", so I assume the high pricing and usage caps on the ChatGPT version are to keep the load manageably low for the moment.

You're not wrong but I think many people still have an intuition informed by a pre-silicon-capacity-crunch era, it cannot be taken for granted that the demand for GPU / TPU will be met over the next few years.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#38

Post by sebzim4500 »

Why is the 32K context only twice as expensive as the 8K context?

Are they using sparse attention or something? I don't think flash attention on it's own can explain it.

EDIT: Oh right, if the cost is per token so if you actually fill the context then it is 8x more, which makes much more sense.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#39

Post by OmarAssadi »

icapybara wrote: post #11
lewdev wrote: post #2

And website still says "openai."

Should they not be able to make money off a world changing new technology they bet billions on? Does your company offer all its products for free?

I pay for ChatGPT Plus and have paid a fair bit in OpenAI API fees; I don't care that they are making money. The problem is the openwashing, not the monetization.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#40

Post by aiappreciator »

dogma1138 wrote: post #37

Designer leather jackets boutiques world wide are rejoicing.

I remember as a young gamer, asking my Dad whether Nvidia or Intel was a bigger company. It seemed obvious to me, since people always bragged about their GPUs online, but never the CPU, that Nvidia is the more important company.

At that time, Nvidia was worth like 1% of Intel.

Today, regarding online discussions, nothing has changed. People still brag about GPUs, never the CPU. But now Nvidia is worth 5 times as much as Intel.

Post reply on HN