Earlier quoted context omitted.
I just watched a video that convincingly showed that it is energy and energy alone that determines the production growth of humanity. Until the day AI can "generate" stuff (you know, something out of nothing) it can only at best streamline existing production, which is entirely capped by energy limits. We may drown in oceans of audio, video, novels, poems, films, porn, blue prints, chemical formulas, etc. dreamed up…
Care to give a link to that video?
Introducing ChatGPT and Whisper APIs
381–390 of 696 posts
Re: Introducing ChatGPT and Whisper APIs
#382Earlier quoted context omitted.
It's also worth mentioning that, because Microsoft is an investor, they're likely getting these at cost or subsidized. OpenAI doesn't have to make money right away. They can lose a small bit of money per API request in exchange for market share (preventing others from disrupting them). As the cost of GPUs goes down, or they develop at ASIC or more efficient model, they can keep their pricing the same and then make mo…
> As the cost of GPUs goes down Has that been happening? I guess there's been a bit of a dip after the crypto crash, but are prices staying significantly lower? > or they develop at ASIC or more efficient model This seems likely. Probably developing in partnership with Microsoft.
It's definitely not happening at the high end of the market (NVIDIA A100s with 40GB or 80GB of RAM).
The cards that were used for mining have since crashed in terms of prices, but those were always gamer cards and very rarely Datacenter cards.
Re: Introducing ChatGPT and Whisper APIs
#383Earlier quoted context omitted.
Not anything racist or illegal but yes I find pc culture insufferable. It stifles creativity and most importantly reduces trust between parties. For context I am an Indian guy.
Politeness, lack of hate, etc. generally increase trust; that's much of their purpose. How do racial slurs increase trust? How do you define "pc culture", and what specifically causes problems and how? Attacking other people's beliefs as "insufferable", and aggressively demonstrating close-mindedness to them, tends to reduce trust.
[flagged]
Re: Introducing ChatGPT and Whisper APIs
#384Earlier quoted context omitted.
It's also worth mentioning that, because Microsoft is an investor, they're likely getting these at cost or subsidized. OpenAI doesn't have to make money right away. They can lose a small bit of money per API request in exchange for market share (preventing others from disrupting them). As the cost of GPUs goes down, or they develop at ASIC or more efficient model, they can keep their pricing the same and then make mo…
> As the cost of GPUs goes down Has that been happening? I guess there's been a bit of a dip after the crypto crash, but are prices staying significantly lower? > or they develop at ASIC or more efficient model This seems likely. Probably developing in partnership with Microsoft.
I understood this as $/FLOP, I think it's plausible that that has been happening.
Re: Introducing ChatGPT and Whisper APIs
#385I hope this pricing impacts ChatGPT+ $20 is equivalent to what, 10,000,000 tokens? At ~750 words/1k tokens, that’s 7.5 million words per month, or roughly 250,000 words per day, 10,416 words per hour, 173 words per minute, every minute, 24/7. I uh, do not have that big of a utilization need. It’s kind of weird to vastly overpay
> 10,416 words per hour, 173 words per minute, every minute, 24/7. Unless I'm misunderstanding something, it does not sound like that much when every query you make carries several hundred words of prompt, context and "memory". If the input you type is a couple words, but has 1k extra words automatically prepended, then the limits turn into 10 queries per hour, or one per 6 minutes.
Even with that math, I do not interact with ChatGPT 240 times per day.
Re: Introducing ChatGPT and Whisper APIs
#386Whisper as an API is great, but having to send the whole payload upfront is a bummer. Most use cases I can build for would want streaming support. Like establish a WebRTC connection and stream audio to OpenAI and get back a live transcription until the audio channel closes.
As far as I can tell it doesn't support world-level timestamps (yet). That's a bit of a dealbreaker for things like promotional clips or the interactive transcripts that we do[^0]. Hopefully they add this soon. [^0]: https://www.withfanfare.com/p/seldon-crisis/future-visions-w...
[deleted]
Re: Introducing ChatGPT and Whisper APIs
#387I've stopped using Google entirely and don't miss it a second - something i wouldn't have thought possible a year ago - and it's pretty difficult to see how Google will survive this disaster.
How are you using it? In my experience asking factual questions lead to answers so inaccurate that you might as well not bother. Are you prompting it differently to me, or do you have some strategy to filter out the BS?
I use it with documents I shred into sentences and embed with ada-002. This makes it spot on when talking about a given document. https://mitta.us/
Re: Introducing ChatGPT and Whisper APIs
#388Could explain what the point of "Bearer" is in this authorization header? "Authorization: Bearer $OPENAI_API_KEY"
Bearer indicates the type of credential being supplied in the Authorization header. Bearer tokens are a type of credential, introduced in RFC6750 [0]. Essentially the OpenAI api key you’re using is a form of bearer token, and that’s why the Bearer type should be included there. Other authentication methods (like username/password or “Basic”) use the Authorization header too, but specify “Authorization: Basic ”. [0] h…
Does it mostly just mean that, for non-JWT-style tokens, the same string essentially serves as both a "username" and a "password"?
Re: Introducing ChatGPT and Whisper APIs
#389Earlier quoted context omitted.
Most of the value for me with ChatGPT+ is getting access when the system is at capacity.
Same here. That was the sole reason I upgraded. There were a few times where I really needed ChatGPT at a specific time and got the "we're at capacity" message. $20/mo is nothing to have that go away.
When you say you "really needed" ChatGPT, what was the use case?
Re: Introducing ChatGPT and Whisper APIs
#390Earlier quoted context omitted.
I thought it was Midjourney who stole their thunder. Stable Diffusion is free but it's much harder to get good results with it. Midjourney on the other hand spits out art with a very satisfying style.
You are like 2 months out of date. Stable diffusion now has a massive ecosystem around it (civitai/automatic1111), that when used well, completely crushes any competitors in terms of the images it produces. Midjourney is still competitive, but mostly because its easier to use. Dalle2 will get you laughed out of the room in any ai art discussion.
Ridiculous. Stable diffusion might have a massive ecosystem around it but mid journey is making money hand over fist. Most people don't even necessarily have a discreet GPU necessary to be able to run SD, and the vast majority of artists that I know are using midjourney and then doing touchups afterwards.
Even with all the different models that you can load in stable diffusion MJ is 1000 times better at natural language parsing and understanding, and requires significantly less prompt crafting to be able to get aesthetically pleasing results.
Having used automatic1111 heavily with an RTX 2070, the only area I'll concede SD can do a better job is in closeup Headshots and character generation. MJ blows SD out of the water where complex prompts involving nuanced actions are concerned.
Once midjourney adds controlnet and inpainting to their website that's pretty much game over.