Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

121–130 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#121
post #108

Earlier quoted context omitted.

> I have no idea how OpenAI can make money on this. I did some quick calculation. We know the number of floating point operations per token for inference is approximately twice the number of parameters(175B). Assuming they use 16 bit floating point, and have 50% of peak efficiency, A100 could do 300 trillion flop/s(peak 624[0]). 1 hour of A100 gives openAI $0.002/ktok * (300,000/175/2/1000)ktok/sec * 3600=$6.1 back.…

Isn’t it 2.25 per hour per a100?

Yes, he means 2.25 per hour with a 1 yr reservation.

Re: Introducing ChatGPT and Whisper APIs

#124
post #33

Earlier quoted context omitted.

I thought it was Midjourney who stole their thunder. Stable Diffusion is free but it's much harder to get good results with it. Midjourney on the other hand spits out art with a very satisfying style.

You are like 2 months out of date. Stable diffusion now has a massive ecosystem around it (civitai/automatic1111), that when used well, completely crushes any competitors in terms of the images it produces. Midjourney is still competitive, but mostly because its easier to use. Dalle2 will get you laughed out of the room in any ai art discussion.

Do you have any recently updated examples, blog posts, whatever showing that DALLE is worse than modern stable diffusion? I was still under the impression that DALLE was better (with better meaning the images are more likely to be what you asked for, more lifelike, more realistic, not necessarily artistically pleasing), with the downside of it being locked away and somewhat expensive. And my understanding is that stable diffusion 2.0+ is actually a step backwards in terms of quality, especially for anything involving images of humans. But as this thread acknowledges, this area is moving very quickly and my knowledge might be out of date, so definitely happy to see some updated comparisons if you have any to suggest. It feels like ever since Chat GPT came out, they haven’t been many posts about stable diffusion an image generation, they got crowded out of the spotlight.

Re: Introducing ChatGPT and Whisper APIs

#125

Earlier quoted context omitted.

Adding to that, the human brain is incredibly complex and performs billions of functions. If a person says to me, "I love you" I should be able to ask them why they said that but it would probably be unfair to expect a detailed answer including all their environmental and genetic inputs, many of which they may not be aware of. If ChatGPT says it loves me, I not only expect the system to tell me why that was said but…

>If a person says to me, "I love you" I should be able to ask them why they said that. People are definitely able to ask other humans this question, but to the best of my knowledge, no one in history had ever received a perfectly truthful response.

in general, "i don't know" is a perfectly acceptable answer, and probably should be said more often.

Re: Introducing ChatGPT and Whisper APIs

#126

One of the things I love about the API-ification of these LLMs is that they’re plug and play. I built https://persona.ink against davinci knowing it didn’t give as good of results as ChatGPT but knowing I could swap the model out once 3.5 came out. Today is that day, going to swap out the prompt in the cloudflare worker and it should Just Work(tm)

Typo on your front page—"enfrocement" should be "enforcement."

Re: Introducing ChatGPT and Whisper APIs

#127
post #9

>Through a series of system-wide optimizations, we’ve achieved 90% cost reduction for ChatGPT since December This is seriously impressive. A MILLION tokens for 2 dollars is absolutely fucking insane. I hope that the gains reached here can also be found by open source and non-controlled AI projects. If so, that could be huge for the advancement of AI.

It's tokens processed, not generated.

Re: Introducing ChatGPT and Whisper APIs

#129

Earlier quoted context omitted.

It's amazing that "being two months out of date" in AI means that you are already a dinosaur

For real! This stuff is moving fast . It feels like just last week I was posting about how it's going to change...art. And now there are hilarious deepfake memes of past and current presidents shit talking about video games. There are a handful of ML art subs that have pretty amazing stuff daily. Especially the NSFW ones, which if you've studied any history of media VHS/DVD/Blu-ray/the internet, porn is a major innov…

What are some niche ML art subs to hang around in? Excepting the NSFW..
Post reply on HN