Earlier quoted context omitted.
> I have no idea how OpenAI can make money on this. I did some quick calculation. We know the number of floating point operations per token for inference is approximately twice the number of parameters(175B). Assuming they use 16 bit floating point, and have 50% of peak efficiency, A100 could do 300 trillion flop/s(peak 624[0]). 1 hour of A100 gives openAI $0.002/ktok * (300,000/175/2/1000)ktok/sec * 3600=$6.1 back.…
Isn’t it 2.25 per hour per a100?
Introducing ChatGPT and Whisper APIs
121–130 of 696 posts
Re: Introducing ChatGPT and Whisper APIs
#122Re: Introducing ChatGPT and Whisper APIs
#123Re: Introducing ChatGPT and Whisper APIs
#124Earlier quoted context omitted.
I thought it was Midjourney who stole their thunder. Stable Diffusion is free but it's much harder to get good results with it. Midjourney on the other hand spits out art with a very satisfying style.
You are like 2 months out of date. Stable diffusion now has a massive ecosystem around it (civitai/automatic1111), that when used well, completely crushes any competitors in terms of the images it produces. Midjourney is still competitive, but mostly because its easier to use. Dalle2 will get you laughed out of the room in any ai art discussion.
Re: Introducing ChatGPT and Whisper APIs
#125Earlier quoted context omitted.
Adding to that, the human brain is incredibly complex and performs billions of functions. If a person says to me, "I love you" I should be able to ask them why they said that but it would probably be unfair to expect a detailed answer including all their environmental and genetic inputs, many of which they may not be aware of. If ChatGPT says it loves me, I not only expect the system to tell me why that was said but…
>If a person says to me, "I love you" I should be able to ask them why they said that. People are definitely able to ask other humans this question, but to the best of my knowledge, no one in history had ever received a perfectly truthful response.
Re: Introducing ChatGPT and Whisper APIs
#126One of the things I love about the API-ification of these LLMs is that they’re plug and play. I built https://persona.ink against davinci knowing it didn’t give as good of results as ChatGPT but knowing I could swap the model out once 3.5 came out. Today is that day, going to swap out the prompt in the cloudflare worker and it should Just Work(tm)
Re: Introducing ChatGPT and Whisper APIs
#127>Through a series of system-wide optimizations, we’ve achieved 90% cost reduction for ChatGPT since December This is seriously impressive. A MILLION tokens for 2 dollars is absolutely fucking insane. I hope that the gains reached here can also be found by open source and non-controlled AI projects. If so, that could be huge for the advancement of AI.
Re: Introducing ChatGPT and Whisper APIs
#128turbo isn't listed in Playground, but if you invoke the example curl command (note: /v1/chat/completions) in your terminal, it works.
Re: Introducing ChatGPT and Whisper APIs
#129Earlier quoted context omitted.
It's amazing that "being two months out of date" in AI means that you are already a dinosaur
For real! This stuff is moving fast . It feels like just last week I was posting about how it's going to change...art. And now there are hilarious deepfake memes of past and current presidents shit talking about video games. There are a handful of ML art subs that have pretty amazing stuff daily. Especially the NSFW ones, which if you've studied any history of media VHS/DVD/Blu-ray/the internet, porn is a major innov…