Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

Post reply on HN
Print view View original

81–90 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#81

Post by yieldcrv »

rvz wrote: post #70
polygamous_bat wrote: post #4

Earlier quoted context omitted.

> I have no idea how OpenAI can make money on this. This has to be a loss-leader to lock out competitors before they even get off the ground. The worst thing that can happen to OpenAI+ChatGPT right now is what happened to DallE 2, a competitor comes up with an alternative (even worse if it's free/open like Stable Diffusion) and completely undercuts them. Especially with Meta's new Llama models outperforming GPT-3, it…

I have been saying this since the release of Stable Diffusion that OpenAI is going to struggle as soon as competitors release their models as open source especially when it surpasses GPT-3 and GPT-4. This is why OpenAI is rushing to bring their costs down and to make it close to free, However, Stable Diffusion is leading the race to the bottom and is already at the finish line, since no-one else would release their m…

LLM Legend:

OpenAI = closed source not open AI

DogeLlamaInuGPT = open source AI

Re: Introducing ChatGPT and Whisper APIs

#82

Post by vishal0123 »

minimaxir wrote: post #2

> It is priced at $0.002 per 1k tokens, which is 10x cheaper than our existing GPT-3.5 models. This is a massive, massive deal. For context, the reason GPT-3 apps took off over the past few months before ChatGPT went viral is because a) text-davinci-003 was released and was a significant performance increase and b) the cost was cut from $0.06/1k tokens to $0.02/1k tokens, which made consumer applications feasible wit…

> I have no idea how OpenAI can make money on this.

I did some quick calculation. We know the number of floating point operations per token for inference is approximately twice the number of parameters(175B). Assuming they use 16 bit floating point, and have 50% of peak efficiency, A100 could do 300 trillion flop/s(peak 624[0]). 1 hour of A100 gives openAI $0.002/ktok * (300,000/175/2/1000)ktok/sec * 3600=$6.1 back. Public price per A100 is $2.25 for one year reservation.

[0]: https://www.nvidia.com/en-us/data-center/a100/

[1]: https://azure.microsoft.com/en-in/pricing/details/machine-le...

Re: Introducing ChatGPT and Whisper APIs

#83

Post by ArminRS »

alpark3 wrote: post #50

> Dedicated instances can make economic sense for developers running beyond ~450M tokens per day. 450M tokens * $0.002/1K tokens = $900 per day. I wonder what the exact pricing structure is. (edited for math)

> It is priced at $0.002 per 1k tokens

So it would be $900 per day

Re: Introducing ChatGPT and Whisper APIs

#84

Post by drusepth »

DrBenCarson wrote: post #74
KRAKRISMOTT wrote: post #43

Earlier quoted context omitted.

You have to rebuild all your prompts when switching providers.

If the superlative LLM can’t handle prompts from another provider, it just isn’t the superlative LLM. This area by definition has no moats. English is not proprietary. Use case is everything.

Switching to another LLM isn't always about quality. Being able to host something yourself at a lower or equal quality might be preferred due to cost or other reasons; in this case, there's no assumption that the "new" model will have comparable outputs to another LLM's specific prompt style.

In a lot of cases, you can swap models easier but all the prompt tweaking you did originally will probably need to be done again with the new model's black box.

Re: Introducing ChatGPT and Whisper APIs

#88

Post by rmorey »

r3trohack3r wrote: post #12

Whisper as an API is great, but having to send the whole payload upfront is a bummer. Most use cases I can build for would want streaming support. Like establish a WebRTC connection and stream audio to OpenAI and get back a live transcription until the audio channel closes.

FWIW, AssemblyAI has great trasncript quality in my experience, and they support streaming: https://www.assemblyai.com/docs/walkthroughs#realtime-stream...

Re: Introducing ChatGPT and Whisper APIs

#89

Post by steno132 »

OpenAI released a ChatGPT API while reducing the cost by 10x.

For those claiming OpenAI is for profit: Why would OpenAI do this if they were fixated on making money?

Also, while I wish OpenAI released the code for ChatGPT, I applaud OpenAI for actually making their AI model available, to everyone, right now.

* Google hyped their Bard chatbot...but where is it?

* Facebook took down Galatica.

* Even Bing Chat has a waitlist

Re: Introducing ChatGPT and Whisper APIs

#90

Post by Kurtz79 »

anonylizard wrote: post #42
krelian wrote: post #33

Earlier quoted context omitted.

I thought it was Midjourney who stole their thunder. Stable Diffusion is free but it's much harder to get good results with it. Midjourney on the other hand spits out art with a very satisfying style.

You are like 2 months out of date. Stable diffusion now has a massive ecosystem around it (civitai/automatic1111), that when used well, completely crushes any competitors in terms of the images it produces. Midjourney is still competitive, but mostly because its easier to use. Dalle2 will get you laughed out of the room in any ai art discussion.

Easier to use is often all that it takes.

In Midjourney you get fantastic results just by using their discord and a text prompt.

To get some similar results in Stable Diffusion you need to set it up, download the models, understand how the various moving parts work together, fiddle with the parameters, donwload specific models out of the hundreds (thousands?) available, iterate, iterate, iterate...

Post reply on HN