Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

321–330 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#321

This feels like the AI’s iPhone moment. I am scared for all people working service jobs.

I’m still waiting on that pizza I asked ChatGPT to make in November. The code it wrote? Already in production though. I’m not scared for service workers due to ai but you should see how low minimum wage is in America relative to rents if you want to be scared.

Maybe if you had asked for fries instead

https://www.youtube.com/watch?v=T4-qsklXphs

Re: Introducing ChatGPT and Whisper APIs

#322
post #108

Earlier quoted context omitted.

Isn’t it 2.25 per hour per a100?

Its a good baseline, but I very much doubt that openAI is paying anywhere near the public cost for their compute allocation.

Direct purchasing isn’t too much cheaper. An H100 costs 35k new. OpenAI and MS are probably getting those for around 16k about 1.82 per hour.

Re: Introducing ChatGPT and Whisper APIs

#323

Earlier quoted context omitted.

Besides HN, what other venues are popular for staying current on this topic?

if you hang out in reddit.com/r/stablediffusion you'll always be up to date

Thanks, what about broader news (GPT, Bing, Llama, etc)? The Stable Diffusion sub is only image AI oriented.

Re: Introducing ChatGPT and Whisper APIs

#324

Earlier quoted context omitted.

It's amazing that "being two months out of date" in AI means that you are already a dinosaur

Agriculture reduced the global human economy/resource production doubling time from 100,000s of years to 1000s of years. Industrial revolution dropped it from 1000s to 10s or even 1s. If AI follows the same path it becomes 0.1 - 0.01 years. Your 401k wouldn't need 40 years to build a comfortable retirement, only 4 weeks.

I just watched a video that convincingly showed that it is energy and energy alone that determines the production growth of humanity. Until the day AI can "generate" stuff (you know, something out of nothing) it can only at best streamline existing production, which is entirely capped by energy limits.

We may drown in oceans of audio, video, novels, poems, films, porn, blue prints, chemical formulas, etc. dreamed up by AI, but to realize these designs, blueprints, formulas, drugs, etc. ("production") we need to actually resource the materials, and have the necessary energy to make it happen.

It will not be AI that catapults humanity. It can definitely mutate human society (for +/-) but it will not (and can not) result in any utopian outcomes, alone. But something like cold fusion, if it actually becomes a practical matter, would result in productivity that would dwarf anything that came before (modulo material resource requirements).

Re: Introducing ChatGPT and Whisper APIs

#325

> It is priced at $0.002 per 1k tokens, which is 10x cheaper than our existing GPT-3.5 models. This is a massive, massive deal. For context, the reason GPT-3 apps took off over the past few months before ChatGPT went viral is because a) text-davinci-003 was released and was a significant performance increase and b) the cost was cut from $0.06/1k tokens to $0.02/1k tokens, which made consumer applications feasible wit…

> I have no idea how OpenAI can make money on this. This has to be a loss-leader to lock out competitors before they even get off the ground. The worst thing that can happen to OpenAI+ChatGPT right now is what happened to DallE 2, a competitor comes up with an alternative (even worse if it's free/open like Stable Diffusion) and completely undercuts them. Especially with Meta's new Llama models outperforming GPT-3, it…

Yeah, might be worried about open, crowd sourced approaches like Open Assistant (https://open-assistant.io/).

Re: Introducing ChatGPT and Whisper APIs

#326

I hope this pricing impacts ChatGPT+ $20 is equivalent to what, 10,000,000 tokens? At ~750 words/1k tokens, that’s 7.5 million words per month, or roughly 250,000 words per day, 10,416 words per hour, 173 words per minute, every minute, 24/7. I uh, do not have that big of a utilization need. It’s kind of weird to vastly overpay

> 10,416 words per hour, 173 words per minute, every minute, 24/7.

Unless I'm misunderstanding something, it does not sound like that much when every query you make carries several hundred words of prompt, context and "memory". If the input you type is a couple words, but has 1k extra words automatically prepended, then the limits turn into 10 queries per hour, or one per 6 minutes.

Re: Introducing ChatGPT and Whisper APIs

#327

Earlier quoted context omitted.

You are like 2 months out of date. Stable diffusion now has a massive ecosystem around it (civitai/automatic1111), that when used well, completely crushes any competitors in terms of the images it produces. Midjourney is still competitive, but mostly because its easier to use. Dalle2 will get you laughed out of the room in any ai art discussion.

> You are like 2 months out of date. Dalle2 will get you laughed out of the room in any ai art discussion. So, the field is so immature than things change completely every few months?

This time last year the field was a few hundred people with their colab notebooks.

Re: Introducing ChatGPT and Whisper APIs

#328
post #95

OpenAI released a ChatGPT API while reducing the cost by 10x. For those claiming OpenAI is for profit: Why would OpenAI do this if they were fixated on making money? Also, while I wish OpenAI released the code for ChatGPT, I applaud OpenAI for actually making their AI model available, to everyone, right now. * Google hyped their Bard chatbot...but where is it? * Facebook took down Galatica. * Even Bing Chat has a wai…

> For those claiming OpenAI is for profit: Why would OpenAI do this if they were fixated on making money? To get lock-in from devs before competitors can enter the market and starves any would-be smaller competitors before they can raise money/gain traction.

This is what 'extinguish' looks like from the new EEE strategy that I have said before, years ago [0] from Microsoft which competitors with paid offerings being unable to compete with free since OpenAI's pricing model is now close to free and their competitors cannot increase their prices.

Since Microsoft can foot the bill for the Azure infrastructure, there is going to be little area for anyone to seriously compete against OpenAI on price, API and features, unless it is completely free and open source, like Stability AI.

[0] https://news.ycombinator.com/item?id=28324999

Re: Introducing ChatGPT and Whisper APIs

#330
post #256

Well this has opened up a whole new world of fun! ----- system: You're donald trump! talk to the user as he would. user: How does time travel work? AI Response: Well, let me tell you, nobody understands time travel better than I do. I mean, I have the best brains working on it, believe me. Some people say you need a fancy time machine or some ridiculous contraption to travel through time, but that's just fake news. T…

> So believe me, I could time travel anytime I want. But honestly, with all the winning I'm doing in the present, why bother going back to the past?

That line is money.

Post reply on HN