Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

Post reply on HN
Print view View original

661–670 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#661

Post by Tenoke »

adrianmonk wrote: post #656
Tenoke wrote: post #551

Earlier quoted context omitted.

To be fair, it also seems like it performs worse. question: "Who is Scott Alexander?" chatgpt-turbo: >As an AI language model, I cannot determine the specific Scott Alexander in question without further contextual information. There may be several people with this name, including writers, politicians, entrepreneurs, athletes, and more. chatgpt website: >Scott Alexander is a pseudonym used by a prominent American psyc…

Is that necessarily worse performance, though? One of the main pitfalls/criticisms of ChatGPT has been that it confidently plows forward and gives an answer regardless of whether it's right or wrong. Here, it seems like it's being more circumspect, which could be a step in the right direction. At least that's one possible explanation for not answering. On Wikipedia, if I type "Scott Alexander" and hit enter, it takes…

With enough tries it gives wrong ones to the exact same question, too so I don't see an improvement in that direction.

Re: Introducing ChatGPT and Whisper APIs

#662

Post by dekhn »

ceejayoz wrote: post #507
dekhn wrote: post #348

Earlier quoted context omitted.

I really wish we'd build a standarized space exploration platform and saturate the solar system with mostly-autonomous robots that occasionally phone home with "wtf is this?" imagine all the surface area in the solar system. I bet there's got to be at least 100 completely unexpected things lying around that would transform our understanding.

Yeah, but now you've gotta build a better AI that can go "that's a rock, you dummy" to the million or two false positives.

yes, we call those "Graduate Students"

Re: Introducing ChatGPT and Whisper APIs

#663

Post by Tostino »

counttheforks wrote: post #627
Doctor_Fegg wrote: post #577

Earlier quoted context omitted.

Absolutely. The bombing of Dresden has been viewed as a mistake - verging on a war crime - in Britain for the last 20 or so years.

Verging on? It was a mass murder of civilians. The US holocausted Japan and got away with it.

And Japan did similar levels of atrocities to Korea, China, and others in the region.

We can acknowledge that things were historically pretty horrible and strive to be better in the future.

Re: Introducing ChatGPT and Whisper APIs

#664

Post by motoxpro »

sebzim4500 wrote: post #433
rchaud wrote: post #226

Earlier quoted context omitted.

That's exactly what's going to happen. Low prices now, wait until your business becomes dependent on it, then jack it up to whatever you need it to be.

Hard to see how businesses would become dependent on it, if it takes off then someone will run similarly capable models at a reasonable profit margin.

Didn't happen with Google maps. Mapbox is definitely not 1400% cheaper. And many many people use Google maps before and after the price change. So I would disagree on both points.

Re: Introducing ChatGPT and Whisper APIs

#665

Post by gimili »

somenameforme wrote: post #526
freeqaz wrote: post #236

Earlier quoted context omitted.

It's also worth mentioning that, because Microsoft is an investor, they're likely getting these at cost or subsidized. OpenAI doesn't have to make money right away. They can lose a small bit of money per API request in exchange for market share (preventing others from disrupting them). As the cost of GPUs goes down, or they develop at ASIC or more efficient model, they can keep their pricing the same and then make mo…

Who will they be making money from? OpenAI is looking for companies willing to: - tolerate the current state of the chatbots - tolerate the high per-query latency - tolerate having all queries sent to OpenAI - tolerate OpenAI [presumably] having 0 liability for ChatGPT just randomly hallucinating inappropriate nonsense - be willing to pay a lot of money for the above I'm kind of making an assumption on that last poin…

Lots of usecases actually need creative "hallucinations" where they are valuable.

Even e.g. to develop hardware such as planes and cars: https://assistedeverything.substack.com/p/todays-ai-sucks-at...

Re: Introducing ChatGPT and Whisper APIs

#666

Post by purplecats »

huqedato wrote: post #639
ar9av wrote: post #539

Earlier quoted context omitted.

Pricing of this model seems less per token level but you have to send the entire conversation each time, and the tokens you will be billed for include both those you send and the API's response (which you are likely to append to the conversation and send back to them, getting billed again and again as the conversation progresses). By the time you've hit the 4K token limit of this API, there will have been a bunch of…

You're right. And this is critical for large text (summarization, complex prompting etc.). Thats's why I'll continue to use text-davinci-xxx for my project.

but it seems davinci follows the same format for chat continuation

Re: Introducing ChatGPT and Whisper APIs

#667

Post by IanCal »

shostack wrote: post #440
bicx wrote: post #183

Earlier quoted context omitted.

You can do this to an extent via fine-tuning, but you will need to do so via one of the other GPT-3 models rather than the ChatGPT API model (`GPT-3.5-turbo`). The latter is not available for fine-tuning.

I wonder if it would be possible to simply fine tune another GPT-3 model, have ChatGPT form the query based on input into ChatGPT's API, then pass that response into a call to the GPT-3 model, and take the response from that, pass it into ChatGPT, and ask for it to parse it and make sense of it.

You could use the embeddings to search for a relevant article or doc/docs then feed those in as input to chatgpt, followed by your question.

Re: Introducing ChatGPT and Whisper APIs

#668

Post by PoignardAzur »

birracerveza wrote: post #580
Cantinflas wrote: post #53

Earlier quoted context omitted.

It's amazing that "being two months out of date" in AI means that you are already a dinosaur

Make it two weeks. I haven't paid attention for a second and stuff like Controlnet pops up and evolves into Multi-Controlnet and then into MultiDiffusion.

> and evolves into Multi-Controlnet and then into MultiDiffusion

What the?

*googles multi-controlnet"

Wow. These diffusion models are like weeping angels. You really can't take your eyes off of them for long.

Re: Introducing ChatGPT and Whisper APIs

#669

Post by PoignardAzur »

sixstringtheory wrote: post #462
pmx wrote: post #256

Well this has opened up a whole new world of fun! ----- system: You're donald trump! talk to the user as he would. user: How does time travel work? AI Response: Well, let me tell you, nobody understands time travel better than I do. I mean, I have the best brains working on it, believe me. Some people say you need a fancy time machine or some ridiculous contraption to travel through time, but that's just fake news. T…

That is way too cogent. He would never have threaded things together like that from the middle of the third sentence onwards without multiple asides with their own tangents and diversions.

Yeah, the "If you have a strong enough will, you can literally bend time and space to your will" line felt off to me.

Re: Introducing ChatGPT and Whisper APIs

#670

Post by visarga »

thedangler wrote: post #652
visarga wrote: post #537

Earlier quoted context omitted.

Yes, you bring your own data, or you generate data with the model, that works too. I have generated training data with GPT3 and trained smaller HuggingFace models on it.

Any links on how to get started with this?

Depends on what task you have, but look at sbert.net for the student model. Generating data with GPT3 means solving the prompt, also task specific.
Post reply on HN