Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

51–60 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#51

Earlier quoted context omitted.

Someone can still undercut them by offering an uncensored version.

This is actually a big deal. They erred on the side of caution, but as a result the responses are nerfed beyond basic "censorship" level. I saw someone describe this as "desperately posistive" and it really resonated with me. It produces underwhelming / unrealistic responses in negative scenarios.

It's just a matter of time before open source models show up with no limits whatsoever.

Re: Introducing ChatGPT and Whisper APIs

#52
post #16

Pricing is good because OpenAI does not need to make any money but needs data for feedback, if everyone switches to open source ( Llama etc. ) they won't get the data they need. Google is testing their system internally with XX thousand users, OpenAI with XXX million users ...

> Data submitted through the API is no longer used for service improvements (including model training) unless the organization opts in

I don't think the pricing is largely driven by intention to scrape API requests for data.

Re: Introducing ChatGPT and Whisper APIs

#53
post #33

Earlier quoted context omitted.

I thought it was Midjourney who stole their thunder. Stable Diffusion is free but it's much harder to get good results with it. Midjourney on the other hand spits out art with a very satisfying style.

You are like 2 months out of date. Stable diffusion now has a massive ecosystem around it (civitai/automatic1111), that when used well, completely crushes any competitors in terms of the images it produces. Midjourney is still competitive, but mostly because its easier to use. Dalle2 will get you laughed out of the room in any ai art discussion.

It's amazing that "being two months out of date" in AI means that you are already a dinosaur

Re: Introducing ChatGPT and Whisper APIs

#55

> It is priced at $0.002 per 1k tokens, which is 10x cheaper than our existing GPT-3.5 models. This is a massive, massive deal. For context, the reason GPT-3 apps took off over the past few months before ChatGPT went viral is because a) text-davinci-003 was released and was a significant performance increase and b) the cost was cut from $0.06/1k tokens to $0.02/1k tokens, which made consumer applications feasible wit…

>I have no idea how OpenAI can make money on this

Microsoft.

Re: Introducing ChatGPT and Whisper APIs

#56
What is the developer experience of using OpenAI's Server-Sent Events endpoint from something else than their Python and Node.js libraries?

The SSE endpoint is required for use cases like chat so the end user doesn't have to wait until the whole reply has been generated.

I started implementing a simple SSE client on top of C#/.Net's HttpClient but it's harder than I first assumed.

Re: Introducing ChatGPT and Whisper APIs

#57

Does ChatGPT yet have a debug function to Show Its Work so to speak? I think this will be important in the future when it gets itself into drama, trouble, etc.. Probably also useful to prove how ChatGPT created something rather than being known as an opaque box.

I'm pretty sure any system built via linear regression or similar is an opaque box even to the most experienced researchers. For example: https://clementneo.com/posts/2023/02/11/we-found-an-neuron

These are massive functions with billions of parameters that evolved over millions of computing years.

Re: Introducing ChatGPT and Whisper APIs

#58

Earlier quoted context omitted.

You are like 2 months out of date. Stable diffusion now has a massive ecosystem around it (civitai/automatic1111), that when used well, completely crushes any competitors in terms of the images it produces. Midjourney is still competitive, but mostly because its easier to use. Dalle2 will get you laughed out of the room in any ai art discussion.

It's amazing that "being two months out of date" in AI means that you are already a dinosaur

For real! This stuff is moving fast. It feels like just last week I was posting about how it's going to change...art. And now there are hilarious deepfake memes of past and current presidents shit talking about video games.

There are a handful of ML art subs that have pretty amazing stuff daily. Especially the NSFW ones, which if you've studied any history of media VHS/DVD/Blu-ray/the internet, porn is a major innovation driver because humans are thirsty creatures.

Re: Introducing ChatGPT and Whisper APIs

#59
post #9

>Through a series of system-wide optimizations, we’ve achieved 90% cost reduction for ChatGPT since December This is seriously impressive. A MILLION tokens for 2 dollars is absolutely fucking insane. I hope that the gains reached here can also be found by open source and non-controlled AI projects. If so, that could be huge for the advancement of AI.

A lot of people assumed GPT4 would be an even bigger model, but I've been thinking it'll probably be more about more efficient compute.

This is at least some evidence that they're working on that.

Re: Introducing ChatGPT and Whisper APIs

#60

> It is priced at $0.002 per 1k tokens, which is 10x cheaper than our existing GPT-3.5 models. This is a massive, massive deal. For context, the reason GPT-3 apps took off over the past few months before ChatGPT went viral is because a) text-davinci-003 was released and was a significant performance increase and b) the cost was cut from $0.06/1k tokens to $0.02/1k tokens, which made consumer applications feasible wit…

It’s now subsidized by Bing advertisements. They will lose plenty of money but they’re after Google.
Post reply on HN