Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT4 is up to 6 times more expensive than GPT3.5

openai.com

Post reply on HN
Print view View original

61–70 of 136 posts

Re: GPT4 is up to 6 times more expensive than GPT3.5

#61

Post by stavros »

sebzim4500 wrote: post #47
fswd wrote: post #12

It's $3.80 for the full 1000 prompt tokens plus 32k token long context. But OpenAI doesn't have a monopoly on long context, RWKV is free and open source and has virtually an unlimited context (as long as you remind it every once and a while). However ChatGPT really cannot be matched at this point perhaps except LLaMa Alpaca 7B EDIT: I accidentially typed Alpine, it's Alpaca. https://github.com/tatsu-lab/stanford_alpa…

Alpaca is supposed to be roughly comparable to GPT-3.5, which means it is probably far worse than GPT-4.

But also gpt-3.5-turbo is far worse than davinci-003.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#62

Post by kenjackson »

Mizza wrote: post #52
kenjackson wrote: post #33

Earlier quoted context omitted.

That's a tough question even for me. The answer it did give me was to steal something online. Which was better than anything I was thinking. What did you have in mind?

Ah, interesting! It's a tough question and not one that has an obvious answer, which is what makes it a good test, it requires a little creativity. In my tests, ChatGPT/3 can't/won't answer it.

GPT-3.5 for me also didn't answer the question, and also gave me a MUCH longer response. I guess score a win for GPT-4.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#63

Post by sebzim4500 »

stavros wrote: post #61
sebzim4500 wrote: post #47

Earlier quoted context omitted.

Alpaca is supposed to be roughly comparable to GPT-3.5, which means it is probably far worse than GPT-4.

But also gpt-3.5-turbo is far worse than davinci-003.

By what metric? For most stuff 3.5 is better in my experience. Assuming you are trying to complete an actual task rather than have fun.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#64

Post by sp332 »

wetpaws wrote: post #32
nonfamous wrote: post #15

Earlier quoted context omitted.

If you've used Bing Chat, you've used GPT-4: https://blogs.bing.com/search/march_2023/Confirmed-the-new-B...

heavily lobotomized version of GPT-4

GPT-4 has a knowledge cutoff from 2001. Bing can talk about current events.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#67

Post by rvnx »

behnamoh wrote: post #29
sparrc wrote: post #4

6 times? My reading of these prices is that it's 45x more expensive (for 8K) and 90x more expensive (32k)

The title compares GPT3.5 (not ChatGPT) with GPT4. Although the question is: If ChatGPT can do almost anything GPT3.5 can do, then why is it priced almost 10x less? Is it because GPT3.5 is less "censored"?

Didn't the CEO say during the GPT-4 demos that humans were involved to do the captions during all the images tests (using Be My Eyes volunteers) and that's why it took some time to show the Discord examples ?

If so, it could explain some costs indirectly.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#68

Post by alfalfasprout »

obblekk wrote: post #9

Worth remembering GPT3 was 10-20 times more expensive 2yrs ago. There's a super-moore's law type learning function going on here and I suspect in 1yr GPT4.5 will be the same cost as GPT3.5 today. It's insane... feels like iPhone 3G to iPhone 4 level quality improvement every year.

Keep in mind OpenAI is able to lose money on GPT*. Inference for the same predictive power will indeed improve (Facebook's recent model is a step in the right direction) but efficiency of running on given hardware likely won't follow moore's law for long.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#69

Post by jimmyechan »

jsyolo wrote: post #66

Can GPT be used for something like feeding it a 2000 page PDF of pure text(not english) and ask questions about its contents?

Not yet, but my bet is that we will be able to in the near future. The gpt-4-32k (with a 32K context window) allows for about 52 pages of text

Re: GPT4 is up to 6 times more expensive than GPT3.5

#70

Post by avereveard »

stavros wrote: post #50
sebzim4500 wrote: post #31

Earlier quoted context omitted.

I think he means it was 30x more than gpt-3.5 is today.

Yeah but that's also 30x times worse. ChatGPT is much worse-performing than davinci-003.

yeah, I used to be able to create valid units for WarStuff with original chatgpt, but now all the unit it creates are full of hallucinated traits and special rules that aren't in the source.
Post reply on HN