Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

Post reply on HN
Print view View original

501–510 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#501

Post by dgacmu »

sebzim4500 wrote: post #434
BasilPH wrote: post #273

Earlier quoted context omitted.

We're using AssemblyAI too, and I agree that their transcription quality is good. But as soon as Whisper supports world-level timestamps, I think we'll seriously consider switching as the price difference is large ($0.36 per hour vs $0.9 per hour).

Both of those prices strike me as quite high, given that Whisper can be run relatively quickly on commodity hardware. It's not like the bandwidth is significant either, it's just audio.

It's pretty great from my perspective. I've been creating little supplemental ~10 minute videos for my class (using descript; i should probably switch to OBS), and the built in transcription is both wonderful (that it has it at all and is easy to fix) and horrible (the number of errors is very high). I'd happily pay a dime to have a higher quality starting transcription that saves me 5 minutes of fixing...

Re: Introducing ChatGPT and Whisper APIs

#502

Post by rwill128 »

TechBro8615 wrote: post #428
salted-fry wrote: post #358

Earlier quoted context omitted.

Perhaps you were using a different version, but I just tried and ChatGPT didn't seem to have any ethical issues with the question (although it was cagey about giving any definite answer): https://i.imgur.com/5aIjtMz.png

Thank you for posting a link to an image instead of polluting the future training data of GPT-4 with the output of GPT-3 :) I wish more people would do this. I'm getting pretty sick of the walls of text.

That pollution is inevitable, why delay it? It's a technical problem they should be able to solve, and if they can't, then they're revealing the weakness of their methods and the shortcomings of their so-called AI.

It's absolutely ridiculous to expect the entire internet to adopt some kind of hygiene practices when it comes to text from GPT tools simply for the sake of making the training process slightly easier for a company that certainly should have the resources to solve the problem on their own.

If that's why you're using images instead of text you're fighting such a losing battle that it boggles my mind. Why even think about it?!

Re: Introducing ChatGPT and Whisper APIs

#503

Post by Tepix »

_just7_ wrote: post #482
ilaksh wrote: post #447

Earlier quoted context omitted.

They also mention in the new API docs that they are no longer keeping data submitted to ChatGPT. Or at least not to the ChatGPT API.

Would probably pile up to an inhuman amount of data storage. Imagine having to pay for storing the equivalent of 1000 tokens of text within that budget of only 0.0002 dollars

That's one zero too many. Storage cost of 1000 tokens (6000 bytes) on a single HDD is $0.000000096 assuming $16/TB

Re: Introducing ChatGPT and Whisper APIs

#504

Post by lee101 »

minimaxir wrote: post #2

> It is priced at $0.002 per 1k tokens, which is 10x cheaper than our existing GPT-3.5 models. This is a massive, massive deal. For context, the reason GPT-3 apps took off over the past few months before ChatGPT went viral is because a) text-davinci-003 was released and was a significant performance increase and b) the cost was cut from $0.06/1k tokens to $0.02/1k tokens, which made consumer applications feasible wit…

[dead]

Re: Introducing ChatGPT and Whisper APIs

#505

Post by lee101 »

dharma1 wrote: post #371
vishal0123 wrote: post #82

Earlier quoted context omitted.

> I have no idea how OpenAI can make money on this. I did some quick calculation. We know the number of floating point operations per token for inference is approximately twice the number of parameters(175B). Assuming they use 16 bit floating point, and have 50% of peak efficiency, A100 could do 300 trillion flop/s(peak 624[0]). 1 hour of A100 gives openAI $0.002/ktok * (300,000/175/2/1000)ktok/sec * 3600=$6.1 back.…

Reckon they will (if not already) use 4bit or 8bit precision and may not need 175b params

[dead]

Re: Introducing ChatGPT and Whisper APIs

#507

Post by ceejayoz »

dekhn wrote: post #348
danjac wrote: post #305

Earlier quoted context omitted.

AI is the perfect job for asteroid mining, or any other job outside of Earth orbit, whether for research or commerce. Space is incredibly hostile to humans and, short of some miracle technology, is likely to always remain so: at best we'll have a few plant-the-flag missions in the inner solar system.

I really wish we'd build a standarized space exploration platform and saturate the solar system with mostly-autonomous robots that occasionally phone home with "wtf is this?" imagine all the surface area in the solar system. I bet there's got to be at least 100 completely unexpected things lying around that would transform our understanding.

Yeah, but now you've gotta build a better AI that can go "that's a rock, you dummy" to the million or two false positives.

Re: Introducing ChatGPT and Whisper APIs

#508

Post by Sebb767 »

sroussey wrote: post #407
pelasaco wrote: post #332

Earlier quoted context omitted.

yes, specially that you don't have to deal with buying it, maintaining it, etc...

Not sure why people are so scared of this (in general). Yes, it’s a pain, but only an occasional pain. I’ve had servers locked up in a cage for years without seeing them. And the cost for bandwidth has plummeted over the last two decades. (Not at AWS, lol)

The problem isn't the good times, the problem is when something happens in the middle of the night, when a RAM stick goes bad or when you suddenly need triple the compute power. Usually, you get to feel the pain when you need it the least.

I'm hosting a lot of stuff myself on my own hardware, so I do sympathize with this argument, but in a time>>money situation, going to the cloud makes a lot of sense.

Re: Introducing ChatGPT and Whisper APIs

#509

Post by ajhai »

flutas wrote: post #488
ajhai wrote: post #184

gpt-3.5-turbo is missing from Open AI's playground. For anyone looking to play with these models, we have now added them to Promptly playground at https://trypromoptly.com . https://twitter.com/ajhai/status/1631020290502463489 has a quick demo.

FYI and for others, typo in the URL. Should be https://trypromptly.com/

Oops. Thanks for the correction.

Re: Introducing ChatGPT and Whisper APIs

#510

Post by chipgap98 »

stevev wrote: post #411
minimaxir wrote: post #2

> It is priced at $0.002 per 1k tokens, which is 10x cheaper than our existing GPT-3.5 models. This is a massive, massive deal. For context, the reason GPT-3 apps took off over the past few months before ChatGPT went viral is because a) text-davinci-003 was released and was a significant performance increase and b) the cost was cut from $0.06/1k tokens to $0.02/1k tokens, which made consumer applications feasible wit…

Elon is making an open-source version. OpenAI either make it affordable or be left in the dust.

I have bridge in Brooklyn to sell you
Post reply on HN