OpenAI API pricing update FAQ

#1

Post by thorum » Mon, Aug 22, 2022, 5:32 PM UTC

OpenAI API pricing update FAQ
help.openai.com

Re: OpenAI API pricing update FAQ

#2

Post by minimaxir » Mon, Aug 22, 2022, 4:54 PM UTC

This is actually a big deal since this includes the davinci model everyone uses and was the biggest obstacle to cost-affordable deployment of GPT-3.

The exemption for finetuned models is interesting: since they were 2x the price of the old prices, they're now 4x-6x more expensive than the base models. I bet that's how OpenAI really makes their money with enterprise.

Re: OpenAI API pricing update FAQ

#3

Post by hda2 » Mon, Aug 22, 2022, 5:28 PM UTC

Any GPT-3-level fully-opensource models yet?

Re: OpenAI API pricing update FAQ

#4

Post by minimaxir » Mon, Aug 22, 2022, 5:30 PM UTC

hda2 wrote: post #3

Any GPT-3-level fully-opensource models yet?

BLOOM and OPT are both GPT-3 sized models that are open source and similarily sized (175B parameters) but a) text generation is not as good as GPT-3 for whatever reason and b) getting them to run in a cost-effective manner is not easy and with this new price decrease, it may be more economical to use GPT-3 for deployment despite that.

Re: OpenAI API pricing update FAQ

#5

Post by arbol » Mon, Aug 22, 2022, 5:32 PM UTC

Any chance of this making GitHub copilot cheaper?

Re: OpenAI API pricing update FAQ

#6

Post by AJRF » Mon, Aug 22, 2022, 5:34 PM UTC

> We have been looking forward to reducing pricing for a long time. Our teams have made incredible progress in making our models more efficient to run, which has reduced the cost it takes to serve them, and we are now passing these savings along to our customers.

Nothing to do with Stable Diffusion then, no?

Re: OpenAI API pricing update FAQ

#7

Post by intrasight » Mon, Aug 22, 2022, 5:34 PM UTC

Honest question: What does GPT-3 add to my tookbox as a developer?

Re: OpenAI API pricing update FAQ

#8

Post by edgyquant » Mon, Aug 22, 2022, 5:36 PM UTC

minimaxir wrote: post #4

hda2 wrote: post #3

Any GPT-3-level fully-opensource models yet?

BLOOM and OPT are both GPT-3 sized models that are open source and similarily sized (175B parameters) but a) text generation is not as good as GPT-3 for whatever reason and b) getting them to run in a cost-effective manner is not easy and with this new price decrease, it may be more economical to use GPT-3 for deployment despite that.

Is this due to entirely to economies of scale?

Re: OpenAI API pricing update FAQ

#9

Post by powerhour » Mon, Aug 22, 2022, 5:38 PM UTC

intrasight wrote: post #7

Honest question: What does GPT-3 add to my tookbox as a developer?

I wonder if anyone has successfully used it to create library documentation. Obviously you'd have to tweak whatever output you get but can GPT-3 provide a substantial starting point?

Re: OpenAI API pricing update FAQ

#10

Post by rvz » Mon, Aug 22, 2022, 5:38 PM UTC

Or how about opening everything up and releasing all the models as open source?

Since even with these price decreases, lots of competitors are out there with more parameters and are open source, and are already matched or just as good as GPT-3 and are generally running OpenAI's pricing to the ground.

Might as well open everything up since you can't compete with free anyway.