Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI API pricing update FAQ

help.openai.com

Post reply on HN
Print view View original

151–160 of 205 posts

Re: OpenAI API pricing update FAQ

#151

Post by grej »

tvhahn wrote: post #111
AJRF wrote: post #6

> We have been looking forward to reducing pricing for a long time. Our teams have made incredible progress in making our models more efficient to run, which has reduced the cost it takes to serve them, and we are now passing these savings along to our customers. Nothing to do with Stable Diffusion then, no?

Why bother use a GPT-3 model when you can use the free BLOOM model? Large "foundation" models will become a commodity -- a race to the bottom.

I have used BLOOM a little, and I struggle to get it to produce the same kind of output as GPT-3. Anyone have tips there? It often seems to not keep the right context of the previously generated text.

Re: OpenAI API pricing update FAQ

#152

Post by [deleted] »

sebzim4500 wrote: post #148
IncRnd wrote: post #116

Earlier quoted context omitted.

10x is literally the difference of an order of magnitude. An order of magnitude is an exponential change of plus or minus 1 in the value of a quantity or unit. The term is generally used in conjunction with power-of-10 scientific notation. Order of magnitude is used to make the size of numbers and measurements of things more intuitive and understandable. It is generally used to provide approximate comparisons between…

Yeah but it's like the difference between someone saying that their height is 1.8m and saying it is 1.800m. They imply different levels of precision.

[deleted]

Re: OpenAI API pricing update FAQ

#154

Post by IncRnd »

bitdivision wrote: post #140
IncRnd wrote: post #116

Earlier quoted context omitted.

10x is literally the difference of an order of magnitude. An order of magnitude is an exponential change of plus or minus 1 in the value of a quantity or unit. The term is generally used in conjunction with power-of-10 scientific notation. Order of magnitude is used to make the size of numbers and measurements of things more intuitive and understandable. It is generally used to provide approximate comparisons between…

Yes, an order of magnitude literally means 10x. But in my experience, in common speech it's often used to convey an approximation. i.e. 'Changing this will decrease performance of that endpoint by an order of magnitude', when it's really somewhere around 10x. If someone said 'decrease performance by 10x' that seems much more concrete to me.

Not exactly. An order of magnitude change doesn't always mean 10x in base 10! 15 and 150 differ by an order of magnitude but so do 15 and 180.

Re: OpenAI API pricing update FAQ

#155

Post by nicksrose7224 »

tedsanders wrote: post #103
cbm-vic-20 wrote: post #33

I lack imagination. What is GPT-3 (and generative text models in general) useful for, other than toys? It can write essays, can we expect it to replace writers for newspapers and magazines? Can it write coherent technical documentation? Replace speechwriters? Edit: looks like the comment thread below is similar https://news.ycombinator.com/item?id=32554955

As someone who's used the models a fair bit (I work at OpenAI), I mentally sort applications into four buckets: - Generative use cases, where you give the model the kernel of an idea and then you curate its output (e.g., blog writing, code completion, etc.) - Extractive use cases, where you give the model some big piece of text, and then process it in some way (e.g., extract names and addresses, classify it, ask a qu…

This is a really nice breakdown -- I made a little side project that falls into your "Extractive" and "Comparisons" bucket: https://www.tripwise.me/

My tools uses GPT-3 to dig through Airbnb reviews to find the "cons" of staying at a particular place and summarize them neatly. You can also ask any question at all in natural language about all the listings you're evaluating.

I'm bookmarking your repo for future reference, this is very useful

Re: OpenAI API pricing update FAQ

#156

Post by School-Cotton »

copperx wrote: post #97
School-Cotton wrote: post #85

Earlier quoted context omitted.

Consider “cheapness” to be the reciprocal of price; thus, something that costs $30 has a cheapness score of 1/30 antidollars. For this item to become 3x cheaper would mean for its cheapness score to be multiplied by 3, thus 1/10 antidollars. Thus “3x cheaper” means the same thing as “price multipled by one third”.

I like this hypothesis; however, if that was indeed the original meaning, it would have more sense to advertise it as a 33% discount, or as slashing the price by 1/3. "3x cheaper" seems to be aimed to the average Joe shopping for shoes, not to a developer who knows arithmetic.

It's not the same thing as a 33% discount, nor slashing the price by 1/3. It's slashing the price by 2/3.

A 33% discount would be "1.5x cheaper" by my analysis.

Re: OpenAI API pricing update FAQ

#158

Post by itsyaboi »

dr_dshiv wrote: post #136
slavik81 wrote: post #110

Earlier quoted context omitted.

When you say you're an empath, do you mean to claim that you have psychic powers? An empath is a being from science fiction with the psionic ability to sense emotions, like Counselor Troi on Star Trek. The term originates from the short story "Empath" by J. T. McIntosh, published in New Worlds Science Fiction #50, August 1956.

Yes, that is correct. I have psychic powers, specifically the psionic ability to sense emotions. AMA

When did you first become aware of your powers?

Re: OpenAI API pricing update FAQ

#160

Post by nicksrose7224 »

alecco wrote: post #149
cbm-vic-20 wrote: post #33

I lack imagination. What is GPT-3 (and generative text models in general) useful for, other than toys? It can write essays, can we expect it to replace writers for newspapers and magazines? Can it write coherent technical documentation? Replace speechwriters? Edit: looks like the comment thread below is similar https://news.ycombinator.com/item?id=32554955

Besides all the ideas of well meaning people in HN, I fear GPT-3 (and its competitors) will just bring almost impossible to spot fake Amazon reviews, SEO garbage sites, fake blogs, fake podcasts, etc. And even worse, now corporations and governments don't even need to have troll farms. Just rent some AI, give it basic directions, and let it loose. The Dead Internet Theory will become real.

i think this is a bit pessimistic. You can also use GPT-3 or similar technologies to much more easily train a fine-tuned "real vs fake" review classifier with fewer training examples than was previously necessary.

GPT-3 like all tech is double-edged I think. Has good & bad things about it

Post reply on HN