Introducing ChatGPT and Whisper APIs

Post by lordnacho » Wed, Mar 01, 2023, 10:11 PM UTC

eternalban wrote: post #324

flangola7 wrote: post #149

Earlier quoted context omitted.

Agriculture reduced the global human economy/resource production doubling time from 100,000s of years to 1000s of years. Industrial revolution dropped it from 1000s to 10s or even 1s. If AI follows the same path it becomes 0.1 - 0.01 years. Your 401k wouldn't need 40 years to build a comfortable retirement, only 4 weeks.

I just watched a video that convincingly showed that it is energy and energy alone that determines the production growth of humanity. Until the day AI can "generate" stuff (you know, something out of nothing) it can only at best streamline existing production, which is entirely capped by energy limits. We may drown in oceans of audio, video, novels, poems, films, porn, blue prints, chemical formulas, etc. dreamed up…

Post by jmccarthy » Wed, Mar 01, 2023, 10:12 PM UTC

r3trohack3r wrote: post #12

Whisper as an API is great, but having to send the whole payload upfront is a bummer. Most use cases I can build for would want streaming support. Like establish a WebRTC connection and stream audio to OpenAI and get back a live transcription until the audio channel closes.

Post by eternalban » Wed, Mar 01, 2023, 10:13 PM UTC

lordnacho wrote: post #351

eternalban wrote: post #324

Earlier quoted context omitted.

I just watched a video that convincingly showed that it is energy and energy alone that determines the production growth of humanity. Until the day AI can "generate" stuff (you know, something out of nothing) it can only at best streamline existing production, which is entirely capped by energy limits. We may drown in oceans of audio, video, novels, poems, films, porn, blue prints, chemical formulas, etc. dreamed up…

Couldn't the AI invent fusion?

Post by novaRom » Wed, Mar 01, 2023, 10:15 PM UTC

drusepth wrote: post #84

DrBenCarson wrote: post #74

Earlier quoted context omitted.

If the superlative LLM can’t handle prompts from another provider, it just isn’t the superlative LLM. This area by definition has no moats. English is not proprietary. Use case is everything.

Switching to another LLM isn't always about quality. Being able to host something yourself at a lower or equal quality might be preferred due to cost or other reasons; in this case, there's no assumption that the "new" model will have comparable outputs to another LLM's specific prompt style. In a lot of cases, you can swap models easier but all the prompt tweaking you did originally will probably need to be done aga…

Post by UncleOxidant » Wed, Mar 01, 2023, 10:17 PM UTC

freeqaz wrote: post #236

vishal0123 wrote: post #82

Earlier quoted context omitted.

> I have no idea how OpenAI can make money on this. I did some quick calculation. We know the number of floating point operations per token for inference is approximately twice the number of parameters(175B). Assuming they use 16 bit floating point, and have 50% of peak efficiency, A100 could do 300 trillion flop/s(peak 624[0]). 1 hour of A100 gives openAI $0.002/ktok * (300,000/175/2/1000)ktok/sec * 3600=$6.1 back.…

It's also worth mentioning that, because Microsoft is an investor, they're likely getting these at cost or subsidized. OpenAI doesn't have to make money right away. They can lose a small bit of money per API request in exchange for market share (preventing others from disrupting them). As the cost of GPUs goes down, or they develop at ASIC or more efficient model, they can keep their pricing the same and then make mo…