Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT4 is up to 6 times more expensive than GPT3.5

openai.com

Post reply on HN
Print view View original

41–50 of 136 posts

Re: GPT4 is up to 6 times more expensive than GPT3.5

#41

Post by dragonwriter »

behnamoh wrote: post #29
sparrc wrote: post #4

6 times? My reading of these prices is that it's 45x more expensive (for 8K) and 90x more expensive (32k)

The title compares GPT3.5 (not ChatGPT) with GPT4. Although the question is: If ChatGPT can do almost anything GPT3.5 can do, then why is it priced almost 10x less? Is it because GPT3.5 is less "censored"?

> Although the question is: If ChatGPT can do almost anything GPT3.5 can do, then why is it priced almost 10x less?

ChatGPT is GPT-3.5; with specific fine tuning / chat-oriented training, and without customer fine-tuning (at least, currently) available. It’s the particular GPT-3.5 interface that OpenAI wants people to preferentially use, so the price structure artificially encourages this.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#42

Post by cscheid »

sebzim4500 wrote: post #38

Why is the 32K context only twice as expensive as the 8K context? Are they using sparse attention or something? I don't think flash attention on it's own can explain it. EDIT: Oh right, if the cost is per token so if you actually fill the context then it is 8x more, which makes much more sense.

Ask it the other way around, "Why is the 8K context only twice as cheap as the 32K context?" and your original answer is clearer: because they think the demand curve supports it.

Price is not determined by cost, but by how much people are willing to pay.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#43

Post by djbusby »

JohnFen wrote: post #21
icapybara wrote: post #11

Earlier quoted context omitted.

Should they not be able to make money off a world changing new technology they bet billions on? Does your company offer all its products for free?

The problem with the name isn't that they're charging. It's that they're implying that they're something in the ballpark of open source when they're not.

OpenTable isn't Open Source. Open, as a word, has more than one context.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#44

Post by frognumber »

behnamoh wrote: post #29
sparrc wrote: post #4

6 times? My reading of these prices is that it's 45x more expensive (for 8K) and 90x more expensive (32k)

The title compares GPT3.5 (not ChatGPT) with GPT4. Although the question is: If ChatGPT can do almost anything GPT3.5 can do, then why is it priced almost 10x less? Is it because GPT3.5 is less "censored"?

If I were to speculate, OpenAI is doing two types of optimizations:

1) Cost

2) Function

I suspect ChatGPT is 90% a cost-optimized version of GPT3, and 10% a function-enhanced one.

GPT3 was the first major public wow-able model, and I suspect it was not running on any sort of optimized infrastructure.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#45

Post by djbusby »

kenjackson wrote: post #33
Mizza wrote: post #24

Earlier quoted context omitted.

Thanks for the reply. I'm not all that impressed by "what is"/information retrieval tasks, is it any better at "thought" tasks like explanatory reasoning and ideogensis? For instance - "How might an agoraphobic kleptomaniac satisfy both of their desires simultaneously?"

That's a tough question even for me. The answer it did give me was to steal something online. Which was better than anything I was thinking. What did you have in mind?

Steal from a friends house?

Re: GPT4 is up to 6 times more expensive than GPT3.5

#46

Post by alchemist1e9 »

logical_proof wrote: post #30
alchemist1e9 wrote: post #23

Earlier quoted context omitted.

How are you trying it? I’m ChatGPT Plus subscriber but don’t see any change.

You should have the option when you start a new chat to use default or 4

Yes now it gave me that. Not sure why it didn’t before.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#47

Post by sebzim4500 »

fswd wrote: post #12

It's $3.80 for the full 1000 prompt tokens plus 32k token long context. But OpenAI doesn't have a monopoly on long context, RWKV is free and open source and has virtually an unlimited context (as long as you remind it every once and a while). However ChatGPT really cannot be matched at this point perhaps except LLaMa Alpaca 7B EDIT: I accidentially typed Alpine, it's Alpaca. https://github.com/tatsu-lab/stanford_alpa…

Alpaca is supposed to be roughly comparable to GPT-3.5, which means it is probably far worse than GPT-4.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#48

Post by int_is_compress »

Maxion wrote: post #28
obblekk wrote: post #9

Worth remembering GPT3 was 10-20 times more expensive 2yrs ago. There's a super-moore's law type learning function going on here and I suspect in 1yr GPT4.5 will be the same cost as GPT3.5 today. It's insane... feels like iPhone 3G to iPhone 4 level quality improvement every year.

GPT-4 is a scary improvement over 3.5, especially for handling code. It will be the literal definition of awesome when these models get a large enough context space to hold a small-medium sized codebase. I've been playing around with it for an hour seeing what it can do to refactor some of the things we have with the most tech debt, and it is astounding how well it does with how little context I give it.

There are already some cool projects that help LLM go beyond the context window limitation and work with even larger codebases like https://github.com/jerryjliu/llama_index and https://github.com/hwchase17/langchain.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#49

Post by Maxion »

speedgoose wrote: post #34
Maxion wrote: post #28

Earlier quoted context omitted.

GPT-4 is a scary improvement over 3.5, especially for handling code. It will be the literal definition of awesome when these models get a large enough context space to hold a small-medium sized codebase. I've been playing around with it for an hour seeing what it can do to refactor some of the things we have with the most tech debt, and it is astounding how well it does with how little context I give it.

The 32k tokens version should do fairly well on such codebase. I don’t know if it’s the one used in ChatGPT.

I’m not even kidding when I say I just did 6h or so of work in around 45 minutes

Re: GPT4 is up to 6 times more expensive than GPT3.5

#50

Post by stavros »

sebzim4500 wrote: post #31
behnamoh wrote: post #27

Earlier quoted context omitted.

That's incorrect information. The original GPT3 price was about x3 times its current price, not 10-20 times. https://the-decoder.com/openai-cuts-prices-for-gpt-3-by-two-...

I think he means it was 30x more than gpt-3.5 is today.

Yeah but that's also 30x times worse. ChatGPT is much worse-performing than davinci-003.
Post reply on HN