Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 API General Availability

openai.com

Post reply on HN
Print view View original

181–190 of 562 posts

Re: GPT-4 API General Availability

#181

Post by KennyBlanken »

oaktowner wrote: post #130
feoren wrote: post #101

Earlier quoted context omitted.

> you will get a 4xx/5xx response code, but you will still get billed for the request and whatever the servers generated and you didn't get. That's borderline fraudulent. Borderline!? They're regularly charging customers for products they know weren't delivered. That sounds like straight-up fraud to me, no borderline about it.

Sounds positively Muskian.

You mean it's not normal to tell people that it's their fault for driving their $80,000 electric car in heavy rain, because for many years you haven't bothered to properly seal your transmission's speed sensor?

Re: GPT-4 API General Availability

#182

Post by zzzzzzzza »

ftxbro wrote: post #176

> "Starting today, all paying API customers have access to GPT-4." OK maybe I'm stupid but I am a paying OpenAI API customer and I don't have it yet. I see: gpt-3.5-turbo-16k gpt-3.5-turbo gpt-3.5-turbo-16k-0613 gpt-3.5-turbo-0613 gpt-3.5-turbo-0301 I don't see any gpt-4 Edit: Probably my problem is that I upgraded to paid API account within the last month, so I'm not technically a "paying API customer" yet according…

can't speak for others but I have two accounts

1. chat subscription only

2. i have paid for api calls but don't have a subscription

and only #2 currently has gpt4 available in the playground

Re: GPT-4 API General Availability

#183

Post by vander_elst »

swyx wrote: post #154
driscoll42 wrote: post #149

Earlier quoted context omitted.

$10-$20 per query? Can I get some sourcing on that? That's astronomically expensive.

yeah this isnt close. Sam Altman is on record saying its single digit cents per query and then took a massively dilutive $10b investment from microsoft. Even if gpt4 is 8 models in a trenchcoat they wouldnt raise it on themselves by 4 orders of magnitude like that

Single digit cents per query (let's say 2) is A LOT. Let's say the service runs at 10krps (made up, we can discuss about this) it means the service costs 200$ a second i.e 20M$ a day (oversimplifying a day with 100k seconds, but this might be ok to get us in the ballpark), which means that running the model for a year (400 days, sorry simplifying) is around 8B$, so too run 10krps we are in the order of billions per year. We can discuss some of the assumptions but I think that of we are in the ballpark of cents per query the infrastructure costs are significant.

Re: GPT-4 API General Availability

#184

Post by flangola7 »

alpark3 wrote: post #174

>Developers wishing to continue using their fine-tuned models beyond January 4, 2024 will need to fine-tune replacements atop the new base GPT-3 models (ada-002, babbage-002, curie-002, davinci-002), or newer models (gpt-3.5-turbo, gpt-4). Once this feature is available later this year, we will give priority access to GPT-3.5 Turbo and GPT-4 fine-tuning to users who previously fine-tuned older models. We acknowledge…

They address that, OpenAI will cover the cost of re-training on the new models, and the old models don't discontinue until next year.

Re: GPT-4 API General Availability

#185

Post by reaperman »

fnordpiglet wrote: post #180
alpark3 wrote: post #174

>Developers wishing to continue using their fine-tuned models beyond January 4, 2024 will need to fine-tune replacements atop the new base GPT-3 models (ada-002, babbage-002, curie-002, davinci-002), or newer models (gpt-3.5-turbo, gpt-4). Once this feature is available later this year, we will give priority access to GPT-3.5 Turbo and GPT-4 fine-tuning to users who previously fine-tuned older models. We acknowledge…

If you don’t own the weights you don’t own anything. This is why open models are so crucial. I don’t understand any business who is building fine tuned models against closed models.

Right now the closed models are incredibly higher quality than the open models. They're useful as a stopgap for 1-2 years in hopes/expectation of open models reaching a point where they can be swapped in. It burns cash now, but in exchange you can grab more market share sooner while you're stuck using the expensive but high quality OpenAI models.

It's not cost-effective, but it may be part of a valid business plan.

Re: GPT-4 API General Availability

#186

Post by ronsor »

reaperman wrote: post #185
fnordpiglet wrote: post #180

Earlier quoted context omitted.

If you don’t own the weights you don’t own anything. This is why open models are so crucial. I don’t understand any business who is building fine tuned models against closed models.

Right now the closed models are incredibly higher quality than the open models. They're useful as a stopgap for 1-2 years in hopes/expectation of open models reaching a point where they can be swapped in. It burns cash now, but in exchange you can grab more market share sooner while you're stuck using the expensive but high quality OpenAI models. It's not cost-effective, but it may be part of a valid business plan.

If you're finetuning your own model, the closed models being "incredibly higher quality" is probably less relevant.

Re: GPT-4 API General Availability

#188

Post by bravura »

superkuh wrote: post #84

Yikes. They're actually killing off text-davinci-003. RIP to the most capable remaining model and RIP to all text completion style freedom. Now it's censored/aligned chat or instruct models with arbitrary input metaphor limits for everything. gpt3.5-turbo is terrible in comparison. This will end my usage of openai for most things. I doubt my $5-$10 API payments per month will matter. This just lights more of a fire u…

I've never used text-davinci-003 much. Why do you like it so much? What does it offer that the other models don't?

What are funs things we can with it until it sunsets on January 4, 2024?

Re: GPT-4 API General Availability

#189

Post by oaktowner »

KennyBlanken wrote: post #181
oaktowner wrote: post #130

Earlier quoted context omitted.

Sounds positively Muskian.

You mean it's not normal to tell people that it's their fault for driving their $80,000 electric car in heavy rain , because for many years you haven't bothered to properly seal your transmission's speed sensor?

LOL.

I meant it's not normal to start selling a feature in 2016 and delivering it in beta seven years later.

Re: GPT-4 API General Availability

#190

Post by claytonjy »

ronsor wrote: post #186
reaperman wrote: post #185

Earlier quoted context omitted.

Right now the closed models are incredibly higher quality than the open models. They're useful as a stopgap for 1-2 years in hopes/expectation of open models reaching a point where they can be swapped in. It burns cash now, but in exchange you can grab more market share sooner while you're stuck using the expensive but high quality OpenAI models. It's not cost-effective, but it may be part of a valid business plan.

If you're finetuning your own model, the closed models being "incredibly higher quality" is probably less relevant.

That's how we all want it to work, but the reality today is that GPT-4 is better at almost anything than a fine-tuned version of any other model.

It's somewhat rare to have a task and good enough dataset that you can finetune something else to be close enough in quality to GPT-4 for your task.

Post reply on HN