Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI API pricing update FAQ

help.openai.com

Post reply on HN
Print view View original

41–50 of 205 posts

Re: OpenAI API pricing update FAQ

#41

Post by dr_dshiv »

cbm-vic-20 wrote: post #33

I lack imagination. What is GPT-3 (and generative text models in general) useful for, other than toys? It can write essays, can we expect it to replace writers for newspapers and magazines? Can it write coherent technical documentation? Replace speechwriters? Edit: looks like the comment thread below is similar https://news.ycombinator.com/item?id=32554955

It’s incredibly good at generating scholarly text. Put in a title and abstract and it will come up with a strong intro that is clear and compelling. It helps me write academic papers more clearly, as a result. Also, great for early stages of grant writing or proposals. It came up with a fantastic conference proposal for me that I spent 20 minutes editing and then just sent, unedited.

It will aid speechwriters or help more people write their own speeches, I guess.

Assuming that AI tech is a person replacement is, IMO, the wrong mental model. It helps talented people be more efficient. And will help a lot of hacks “fake it till they make it.” Power to the people, if they can handle it.

Re: OpenAI API pricing update FAQ

#42

Post by colejohnson66 »

rvz wrote: post #10

Or how about opening everything up and releasing all the models as open source? Since even with these price decreases, lots of competitors are out there with more parameters and are open source, and are already matched or just as good as GPT-3 and are generally running OpenAI's pricing to the ground. Might as well open everything up since you can't compete with free anyway.

The free alternatives to OpenAI are not as good as OpenAI. For example, Craiyon (formally DALL-E Mini), is good, but it's nothing compared to the real DALL-E.

Re: OpenAI API pricing update FAQ

#43

Post by ivalm »

intrasight wrote: post #7

Honest question: What does GPT-3 add to my tookbox as a developer?

Maybe not for a developed, but for an AI based startup:

1. Generate synthetic data that is well aligned to your needs. With careful prompting + ensembling + after-fact human filtering you can generate a lot of very particular human-like data that you can then used to train/etc your product.

2. Generate labels. gpt-3 can give pretty good NLU results through appropriate prompting. You can do multiple prompts + ensembling to get very good labels on free text (sentiment, entity linking, intent, etc).

In both above use cases you can actually avoid deploying gpt-3 as part of client facing product, but instead leverage gpt-3 to train smaller "on-rails" models/rules/etc.

Re: OpenAI API pricing update FAQ

#44

Post by dr_dshiv »

aabhay wrote: post #40
simonw wrote: post #38

Earlier quoted context omitted.

I wrote a few notes in this comment: https://news.ycombinator.com/item?id=32554955 Here's one that I find personally really interesting: Imagine you have a disability, and the government agencies responsible for helping you have denied your claim. You need to write them a letter. You don't have much (if any) experience writing letters to government agencies, so you're finding that task challenging. GPT-3 can write th…

How is this different or more useful than providing a template with madlibs-style fill in the blanks?

Because you can tell GPT3 what the concept is — ie, vaguely what you are going for and it will produce. Waaay more flexible than a template.

Re: OpenAI API pricing update FAQ

#45

Post by simonw »

aabhay wrote: post #40
simonw wrote: post #38

Earlier quoted context omitted.

I wrote a few notes in this comment: https://news.ycombinator.com/item?id=32554955 Here's one that I find personally really interesting: Imagine you have a disability, and the government agencies responsible for helping you have denied your claim. You need to write them a letter. You don't have much (if any) experience writing letters to government agencies, so you're finding that task challenging. GPT-3 can write th…

How is this different or more useful than providing a template with madlibs-style fill in the blanks?

Because providing a template requires someone with knowledge of that particular problem space (in this case "writing letters to government agencies to inquire about disability benefits") to put in the work of designing the template, coming up with likely placeholders and predicting how people might need to use it.

GPT-3 can do a good job of this all today, without any additional training.

An expert could help out by providing a few example prompts, but the result would be a lot more powerful and require a lot less development work to put together than trying to build some kind of placeholder wizard from scratch.

Re: OpenAI API pricing update FAQ

#46

Post by mg »

cbm-vic-20 wrote: post #33

I lack imagination. What is GPT-3 (and generative text models in general) useful for, other than toys? It can write essays, can we expect it to replace writers for newspapers and magazines? Can it write coherent technical documentation? Replace speechwriters? Edit: looks like the comment thread below is similar https://news.ycombinator.com/item?id=32554955

GPT-3 is useful for a lot of things. It can write essays, it can write technical documentation, it can write speeches, it can write fiction, it can write poetry, it can write jokes, it can write jokes about jokes, it can write jokes about jokes about jokes, it can write jokes about jokes about jokes about jokes, it can write jokes about jokes about jokes about jokes about jokes, it can write jokes about jokes about jokes about jokes about jokes about jokes, it can write jokes about jokes about jokes about jokes about jokes about jokes about jokes.

This answer was written by GPT-J when I gave it the following prompt:

question: I lack imagination. What is GPT-3 (and generative text models in general) useful for, other than toys? It can write essays, can we expect it to replace writers for newspapers and magazines? Can it write coherent technical documentation? Replace speechwriters?

answer:

Re: OpenAI API pricing update FAQ

#47

Post by renewiltord »

cbm-vic-20 wrote: post #33

I lack imagination. What is GPT-3 (and generative text models in general) useful for, other than toys? It can write essays, can we expect it to replace writers for newspapers and magazines? Can it write coherent technical documentation? Replace speechwriters? Edit: looks like the comment thread below is similar https://news.ycombinator.com/item?id=32554955

My friend used it to "explain like I'm 5" a medical report he had. I sent that to my dad (a surgeon in that specialty) and he said it was all accurate. I thought that was interesting.

But I think the principal use for me is CoPilot.

Re: OpenAI API pricing update FAQ

#48

Post by papandada »

dbrueck wrote: post #22

Is it just me, or are phrases like "3x cheaper" hard for other people to grok too? For some reason they always require me to pause and try to sort it out. Like, is the price being reduced by 66% or 75% or something else? What would "1x cheaper" mean?

From my copy editing days, it's drilled into me to never write "n times less" -- I get that it means "1/n" and that's how I'd rewrite it, but yes, it's notoriously confusing, or at least imprecise.

Re: OpenAI API pricing update FAQ

#49

Post by simonw »

colejohnson66 wrote: post #42
rvz wrote: post #10

Or how about opening everything up and releasing all the models as open source? Since even with these price decreases, lots of competitors are out there with more parameters and are open source, and are already matched or just as good as GPT-3 and are generally running OpenAI's pricing to the ground. Might as well open everything up since you can't compete with free anyway.

The free alternatives to OpenAI are not as good as OpenAI. For example, Craiyon (formally DALL-E Mini), is good, but it's nothing compared to the real DALL-E.

That's true for Craiyon, but Stable Diffusion came out today and looks like it may be able to beat DALL-E in terms of quality some of the time: https://github.com/huggingface/diffusers/releases/tag/v0.2.3

Re: OpenAI API pricing update FAQ

#50

Post by epicide »

dbrueck wrote: post #22

Is it just me, or are phrases like "3x cheaper" hard for other people to grok too? For some reason they always require me to pause and try to sort it out. Like, is the price being reduced by 66% or 75% or something else? What would "1x cheaper" mean?

For me, I tend to think of "3x" and "cheaper" as separate operations. So "3x cheaper" sounds like you're saying new_price = price - 3*price.

That (usually) makes no sense, so I assume people mean something else when they say it, but I never have any clue what. Is it a third of the original price? Is it two thirds (new_price = price - price/3)?

Percentages also work this way. If I say "10% cheaper", most people understand that I mean the price is 90% of what it was previously. Although percentages get weird when increasing the price.

e.g. if it was a flat doubling, I would say that as "200% of the price" (new_price = price*(200/100)).

However, I take "200% more expensive" to mean new_price = price + price*(200/100). To me, the "more" implies addition specifically.

Post reply on HN