Live data from Hacker News

GPT4 is up to 6 times more expensive than GPT3.5

openai.com

11–20 of 136 posts

Re: GPT4 is up to 6 times more expensive than GPT3.5

#12
It's $3.80 for the full 1000 prompt tokens plus 32k token long context. But OpenAI doesn't have a monopoly on long context, RWKV is free and open source and has virtually an unlimited context (as long as you remind it every once and a while). However ChatGPT really cannot be matched at this point perhaps except LLaMa Alpaca 7B

EDIT: I accidentially typed Alpine, it's Alpaca. https://github.com/tatsu-lab/stanford_alpaca

Re: GPT4 is up to 6 times more expensive than GPT3.5

#14
post #13

Does anybody have their hands on it? Is it actually 6 times better at performing tasks, or are we paying more for improved corporate-friendly bumper bowling?

Not the API, but if you pay for ChatGPT Plus you can try it out there.

It's very, very impressive so far - I've tried a bunch of things I've previously run against GPT-3 and got noticeably better results - maybe not a 2x or 6x multiple in "quality" (depending on how you measure that) but still very clearly improved.

Posted a few examples here: https://fedi.simonwillison.net/@simon/110022949941148725

Re: GPT4 is up to 6 times more expensive than GPT3.5

#15
post #13

Does anybody have their hands on it? Is it actually 6 times better at performing tasks, or are we paying more for improved corporate-friendly bumper bowling?

If you've used Bing Chat, you've used GPT-4: https://blogs.bing.com/search/march_2023/Confirmed-the-new-B...

Re: GPT4 is up to 6 times more expensive than GPT3.5

#16
I imagine this price will come down over time. OpenAI has repeatedly said that they haven't the infrastructure in place yet to handle too much load and expect to be "severely capacity constrained", so I assume the high pricing and usage caps on the ChatGPT version are to keep the load manageably low for the moment.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#19
No surprise here, this is Classic Microsoft & OpenAI.

If you know anything about business models this is by design.

The minute that ChatGPT's pricing came close to free, it was obvious they had a way better model.

It was never about OpenAI having found a more efficient way to reduce costs, it was to price out competitors like Google, Meta, Open Source, etc with a "good-enough" breakthrough model.

Then introduce an expensive superior corrected model.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#20
I'm more impressed that it's less than 3 times as expensive as Davinci GPT3. In usecases where most tokens are in the context even only 50% more expensive, while allowing 4x as much context. And you can pay a 100% surcharge to get another fourfold increase in context size.

It only looks expensive when compared to the GPT-3.5-Turbo ChatGPT offering which is incredibly cheap (or alternatively Davinci is overpriced by now)

Post reply on HN