Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT4 is up to 6 times more expensive than GPT3.5

openai.com

Post reply on HN
Print view View original

81–90 of 136 posts

Re: GPT4 is up to 6 times more expensive than GPT3.5

#81

Post by eldenring »

dragonwriter wrote: post #41
behnamoh wrote: post #29

Earlier quoted context omitted.

The title compares GPT3.5 (not ChatGPT) with GPT4. Although the question is: If ChatGPT can do almost anything GPT3.5 can do, then why is it priced almost 10x less? Is it because GPT3.5 is less "censored"?

> Although the question is: If ChatGPT can do almost anything GPT3.5 can do, then why is it priced almost 10x less? ChatGPT is GPT-3.5; with specific fine tuning / chat-oriented training, and without customer fine-tuning (at least, currently) available. It’s the particular GPT-3.5 interface that OpenAI wants people to preferentially use, so the price structure artificially encourages this.

The ChatGPT API is using a smaller model than the original "GPT 3.5". The original, presumably larger, model is used by Legacy ChatGPT.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#82

Post by worldsayshi »

Maxion wrote: post #49
speedgoose wrote: post #34

Earlier quoted context omitted.

The 32k tokens version should do fairly well on such codebase. I don’t know if it’s the one used in ChatGPT.

I’m not even kidding when I say I just did 6h or so of work in around 45 minutes

Do you let it refactor your code base? How do you feed the code to it? Just copy paste?

Re: GPT4 is up to 6 times more expensive than GPT3.5

#83

Post by intelVISA »

nico wrote: post #71
Der_Einzige wrote: post #60

Earlier quoted context omitted.

The fundamental techniques that they use are highly lossey and are far inferior to ultra-long context length models where you can do it all in one prompt. Hate to break it to you and all the others.

Where can someone find and try ultra-long context length models? Any links?

The longest one that is generally available is always going to be yourself :)

Re: GPT4 is up to 6 times more expensive than GPT3.5

#84

Post by jackmott »

djbusby wrote: post #43
JohnFen wrote: post #21

Earlier quoted context omitted.

The problem with the name isn't that they're charging. It's that they're implying that they're something in the ballpark of open source when they're not.

OpenTable isn't Open Source. Open, as a word, has more than one context.

[dead]

Re: GPT4 is up to 6 times more expensive than GPT3.5

#86

Post by Maxion »

worldsayshi wrote: post #82
Maxion wrote: post #49

Earlier quoted context omitted.

I’m not even kidding when I say I just did 6h or so of work in around 45 minutes

Do you let it refactor your code base? How do you feed the code to it? Just copy paste?

Yup, it’s a bit of a learning curve how to get it to output the most useful stuff with the least amount of prompts.

Figure out what your goal is, and then start by giving a wide context and at first it will give wrong answers due to lack of context. With each wrong answer give it some more context fro what you think the solution provide is missing the most. Eventually you get 100% working code, or something so close to it that you can easily and quickly finish it yourself.

This is one strategy, but there are many that you can use to get it to reduce the burden of refactoring.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#87

Post by Raidion »

alfalfasprout wrote: post #68
obblekk wrote: post #9

Worth remembering GPT3 was 10-20 times more expensive 2yrs ago. There's a super-moore's law type learning function going on here and I suspect in 1yr GPT4.5 will be the same cost as GPT3.5 today. It's insane... feels like iPhone 3G to iPhone 4 level quality improvement every year.

Keep in mind OpenAI is able to lose money on GPT*. Inference for the same predictive power will indeed improve (Facebook's recent model is a step in the right direction) but efficiency of running on given hardware likely won't follow moore's law for long.

Are there truely top tier ML optimized chips? I would imagine the hardware space still having room to grow if just because most of the brainpower having been focused on x86, etc.

Re: GPT4 is up to 6 times more expensive than GPT3.5

#88

Post by intelVISA »

Maxion wrote: post #49
speedgoose wrote: post #34

Earlier quoted context omitted.

The 32k tokens version should do fairly well on such codebase. I don’t know if it’s the one used in ChatGPT.

I’m not even kidding when I say I just did 6h or so of work in around 45 minutes

I'm worried it's going to decimate the already wobbly jr market - who are the sr devs of tomorrow to wrangle the LLM output after it replaces the jr's job of coding all day?
Post reply on HN