Earlier quoted context omitted.
Someone can still undercut them by offering an uncensored version.
This is actually a big deal. They erred on the side of caution, but as a result the responses are nerfed beyond basic "censorship" level. I saw someone describe this as "desperately posistive" and it really resonated with me. It produces underwhelming / unrealistic responses in negative scenarios.
Introducing ChatGPT and Whisper APIs
51–60 of 696 posts
Re: Introducing ChatGPT and Whisper APIs
#52Pricing is good because OpenAI does not need to make any money but needs data for feedback, if everyone switches to open source ( Llama etc. ) they won't get the data they need. Google is testing their system internally with XX thousand users, OpenAI with XXX million users ...
I don't think the pricing is largely driven by intention to scrape API requests for data.
Re: Introducing ChatGPT and Whisper APIs
#53Earlier quoted context omitted.
I thought it was Midjourney who stole their thunder. Stable Diffusion is free but it's much harder to get good results with it. Midjourney on the other hand spits out art with a very satisfying style.
You are like 2 months out of date. Stable diffusion now has a massive ecosystem around it (civitai/automatic1111), that when used well, completely crushes any competitors in terms of the images it produces. Midjourney is still competitive, but mostly because its easier to use. Dalle2 will get you laughed out of the room in any ai art discussion.
Re: Introducing ChatGPT and Whisper APIs
#54Re: Introducing ChatGPT and Whisper APIs
#55> It is priced at $0.002 per 1k tokens, which is 10x cheaper than our existing GPT-3.5 models. This is a massive, massive deal. For context, the reason GPT-3 apps took off over the past few months before ChatGPT went viral is because a) text-davinci-003 was released and was a significant performance increase and b) the cost was cut from $0.06/1k tokens to $0.02/1k tokens, which made consumer applications feasible wit…
Microsoft.
Re: Introducing ChatGPT and Whisper APIs
#56The SSE endpoint is required for use cases like chat so the end user doesn't have to wait until the whole reply has been generated.
I started implementing a simple SSE client on top of C#/.Net's HttpClient but it's harder than I first assumed.
Re: Introducing ChatGPT and Whisper APIs
#57Does ChatGPT yet have a debug function to Show Its Work so to speak? I think this will be important in the future when it gets itself into drama, trouble, etc.. Probably also useful to prove how ChatGPT created something rather than being known as an opaque box.
These are massive functions with billions of parameters that evolved over millions of computing years.
Re: Introducing ChatGPT and Whisper APIs
#58Earlier quoted context omitted.
You are like 2 months out of date. Stable diffusion now has a massive ecosystem around it (civitai/automatic1111), that when used well, completely crushes any competitors in terms of the images it produces. Midjourney is still competitive, but mostly because its easier to use. Dalle2 will get you laughed out of the room in any ai art discussion.
It's amazing that "being two months out of date" in AI means that you are already a dinosaur
There are a handful of ML art subs that have pretty amazing stuff daily. Especially the NSFW ones, which if you've studied any history of media VHS/DVD/Blu-ray/the internet, porn is a major innovation driver because humans are thirsty creatures.
Re: Introducing ChatGPT and Whisper APIs
#59>Through a series of system-wide optimizations, we’ve achieved 90% cost reduction for ChatGPT since December This is seriously impressive. A MILLION tokens for 2 dollars is absolutely fucking insane. I hope that the gains reached here can also be found by open source and non-controlled AI projects. If so, that could be huge for the advancement of AI.
This is at least some evidence that they're working on that.
Re: Introducing ChatGPT and Whisper APIs
#60> It is priced at $0.002 per 1k tokens, which is 10x cheaper than our existing GPT-3.5 models. This is a massive, massive deal. For context, the reason GPT-3 apps took off over the past few months before ChatGPT went viral is because a) text-davinci-003 was released and was a significant performance increase and b) the cost was cut from $0.06/1k tokens to $0.02/1k tokens, which made consumer applications feasible wit…