Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

Post reply on HN
Print view View original

111–120 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#111

Post by alfalfasprout »

alexb_ wrote: post #15
machinekob wrote: post #13

Earlier quoted context omitted.

If you are Microsoft as GigaScaler with almost unlimited cash and can ignore getting profit of your api/models its pretty easy to undercut all the other companies and offer it very cheap just to gain advantage in the future.

What the cost cutting measures suggest is that AI like this could maybe soon be run on consumer hardware. That combined with actually open source language models could be huge. OpenAI won't allow for that for obvious reasons, but this confirms that the optimizations are there, and that's exciting enough news on its own.

I mean, meta's new LAMA model runs on a single A100 in the 13B parameter variant (which performs similar to GPT3 65B).

Re: Introducing ChatGPT and Whisper APIs

#113

Post by j45 »

Cantinflas wrote: post #53
anonylizard wrote: post #42

Earlier quoted context omitted.

You are like 2 months out of date. Stable diffusion now has a massive ecosystem around it (civitai/automatic1111), that when used well, completely crushes any competitors in terms of the images it produces. Midjourney is still competitive, but mostly because its easier to use. Dalle2 will get you laughed out of the room in any ai art discussion.

It's amazing that "being two months out of date" in AI means that you are already a dinosaur

One week of change in 2023 is like a month's worth of progress in previous years.

Edit: typo and clarity.

Re: Introducing ChatGPT and Whisper APIs

#114

Post by nickthegreek »

Cantinflas wrote: post #53
anonylizard wrote: post #42

Earlier quoted context omitted.

You are like 2 months out of date. Stable diffusion now has a massive ecosystem around it (civitai/automatic1111), that when used well, completely crushes any competitors in terms of the images it produces. Midjourney is still competitive, but mostly because its easier to use. Dalle2 will get you laughed out of the room in any ai art discussion.

It's amazing that "being two months out of date" in AI means that you are already a dinosaur

I scan the SD subreddit and am subscribed to 3 big ai art youtubes just to stay up to date. With things moving this fast, alot of info is out of date and can be very burdensome to comb through the good stuff later. I try and set aside 30mins twice a week to apply the new techniques to help cement them in my mind and see their strengths and weaknesses. ControlNET really changed the game and now OffsetNoise (check out the IlluminatiDiffusion model) is now really pushing SD passed midjourney for real artistic control of your output.

Re: Introducing ChatGPT and Whisper APIs

#115

Post by [deleted] »

r3trohack3r wrote: post #12

Whisper as an API is great, but having to send the whole payload upfront is a bummer. Most use cases I can build for would want streaming support. Like establish a WebRTC connection and stream audio to OpenAI and get back a live transcription until the audio channel closes.

[deleted]

Re: Introducing ChatGPT and Whisper APIs

#116

Post by dmw_ng »

rburhum wrote: post #85

Can somebody please clarify. Is the cost $0.002 per 1k tokens generated , read , or both?

Both, the API response includes a breakdown. In the best case 1 token = 1 word (for example "and", "the", etc). Depending on input, for English it seems reasonable to multiply the word count by about 1.3 to get a rough token count

This pricing model seems fair since you can pass in huge prompts and request a single word reply, or a few words that expect a large reply

Re: Introducing ChatGPT and Whisper APIs

#117

Post by ChildOfChaos »

anonylizard wrote: post #42
krelian wrote: post #33

Earlier quoted context omitted.

I thought it was Midjourney who stole their thunder. Stable Diffusion is free but it's much harder to get good results with it. Midjourney on the other hand spits out art with a very satisfying style.

You are like 2 months out of date. Stable diffusion now has a massive ecosystem around it (civitai/automatic1111), that when used well, completely crushes any competitors in terms of the images it produces. Midjourney is still competitive, but mostly because its easier to use. Dalle2 will get you laughed out of the room in any ai art discussion.

Stable diffusion might have a reasonable eco system around it, but automatic1111 was always around and 'completely crushes any competitors' is rather rich, Midjourney is still considered the standard as far as I was aware.

I used both again recently and the difference was very clear, midjourney is leaps and bounds above anything else.

Sure, stable diffusion has more control over the output, but the images are usually average at best, were as Midjourney is pretty stunning almost always.

Re: Introducing ChatGPT and Whisper APIs

#118

Post by falcor84 »

LinuxBender wrote: post #99
warent wrote: post #57

Earlier quoted context omitted.

I'm pretty sure any system built via linear regression or similar is an opaque box even to the most experienced researchers. For example: https://clementneo.com/posts/2023/02/11/we-found-an-neuron These are massive functions with billions of parameters that evolved over millions of computing years.

Adding to that, the human brain is incredibly complex and performs billions of functions. If a person says to me, "I love you" I should be able to ask them why they said that but it would probably be unfair to expect a detailed answer including all their environmental and genetic inputs, many of which they may not be aware of. If ChatGPT says it loves me, I not only expect the system to tell me why that was said but…

>If a person says to me, "I love you" I should be able to ask them why they said that.

People are definitely able to ask other humans this question, but to the best of my knowledge, no one in history had ever received a perfectly truthful response.

Re: Introducing ChatGPT and Whisper APIs

#119

Post by waynesonfire »

warent wrote: post #57
LinuxBender wrote: post #44

Does ChatGPT yet have a debug function to Show Its Work so to speak? I think this will be important in the future when it gets itself into drama, trouble, etc.. Probably also useful to prove how ChatGPT created something rather than being known as an opaque box.

I'm pretty sure any system built via linear regression or similar is an opaque box even to the most experienced researchers. For example: https://clementneo.com/posts/2023/02/11/we-found-an-neuron These are massive functions with billions of parameters that evolved over millions of computing years.

it's been some time since I last looked into this topic, my understanding is that linear regression is not a black box as there exist methods that elucidate how the variables impact the response. On the other hand, neural networks are opaque. Again, been a while so there may be ways to ascertain which inputs were used to generate the weights that led to the response. However, I am skeptical that these methods have the same level of mathematical rigor as those used in linear regression.

Re: Introducing ChatGPT and Whisper APIs

#120

Post by j45 »

tstrimple wrote: post #27
karmasimida wrote: post #14

Earlier quoted context omitted.

But this is bound to happen at some point I think? ChatGPT is massive success, but that means the competitor will jump in at all cost, and that includes open source effort.

Bound to happen, so establish yourself as deeply as possible as quickly as possible. Once folks are hooked up to these APIs, there's a cost and friction to switching. This just feels like a land grab that OpenAI is trying to take advantage of by moving quickly.

Thee would be less friction to switch if the implementations (which are early enough) accounted for sending requests to multiple service providers including ones that don't exist yet.

OpenAI has a view few do - how broadly this type of product is actually being used. This is possibly the real lead to not just getting ahead, and staying ahead, but seeing ahead.

Post reply on HN