Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

561–570 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#561

Earlier quoted context omitted.

How are you using it? In my experience asking factual questions lead to answers so inaccurate that you might as well not bother. Are you prompting it differently to me, or do you have some strategy to filter out the BS?

I use it with documents I shred into sentences and embed with ada-002. This makes it spot on when talking about a given document. https://mitta.us/

This is seriously cool. Bots for the people!

Re: Introducing ChatGPT and Whisper APIs

#562
I can think of a variety of uses for this, but they all involve confidential data. Their privacy policy doesn't mention what they do with the prompts/data we send to the API, but I presume It's reviewed and worked into the model.

Re: Introducing ChatGPT and Whisper APIs

#563

I hope this pricing impacts ChatGPT+ $20 is equivalent to what, 10,000,000 tokens? At ~750 words/1k tokens, that’s 7.5 million words per month, or roughly 250,000 words per day, 10,416 words per hour, 173 words per minute, every minute, 24/7. I uh, do not have that big of a utilization need. It’s kind of weird to vastly overpay

I use ChatGPT infrequently so the $20/month isn't worth it to me for pro. I stood up a open source & login-free UI here: https://www.chatwithme.chat/ It accepts your API token and stores it in your browser. It does not have feature parity with ChatGPT but gives you the basics.

I’m impressed by the speed at which you’ve designed this. Have you considered a « Show HN »?

Re: Introducing ChatGPT and Whisper APIs

#564

I switched from their gpt3 davinci model to the new chatgpt3.5-turbo and everyone who used the IRC bot was really disappointed. The chatgpt3.5-turbo is incredibly puritanical and refuses to answer a good fraction of the type of input bots on IRC get. Even innocuous stuff. I was excited about the system/user prompts and being able to easily add short term memory and contexts but if it only responds with, "Oh, it would…

Like what?

Re: Introducing ChatGPT and Whisper APIs

#565

Earlier quoted context omitted.

> I have no idea how OpenAI can make money on this. This has to be a loss-leader to lock out competitors before they even get off the ground. The worst thing that can happen to OpenAI+ChatGPT right now is what happened to DallE 2, a competitor comes up with an alternative (even worse if it's free/open like Stable Diffusion) and completely undercuts them. Especially with Meta's new Llama models outperforming GPT-3, it…

> Especially with Meta's new Llama models outperforming GPT-3 Do you have access to the models? It is being discussed all over the Discords and most seem to think getting access is not happening unless you are dialed in.

I got access by providing an academic email adress without mentioning any relevant publications etc.. Took maybe 2-3 days..

Re: Introducing ChatGPT and Whisper APIs

#566

wow just in time, i just made https://github.com/jackdoe/emacs-chatgpt-jarvis which is chatgpt+whisper but using local whisper and chatgpt-wrapper which is a bit clunky since i integrated chatgpt with my emacs i use it at least 20-30 times a day i wonder if they will charge me per token if i am paying the monthly fee

So cool! I really think this is an awesome future! Everyone has an AI assistant they can interact with via speech.

particularly if you have RSI from 20 years of typing :) with a touchpad that is designed to give you carpal tunnel

Re: Introducing ChatGPT and Whisper APIs

#567

Earlier quoted context omitted.

For real! This stuff is moving fast . It feels like just last week I was posting about how it's going to change...art. And now there are hilarious deepfake memes of past and current presidents shit talking about video games. There are a handful of ML art subs that have pretty amazing stuff daily. Especially the NSFW ones, which if you've studied any history of media VHS/DVD/Blu-ray/the internet, porn is a major innov…

> porn is a major innovation driver because humans are thirsty creatures. Hehe, yeah. I'm personally waiting for a model that is good at nonhuman stuff. Not just furries... but the focus seems to be on human content for now.

train the porn model you want to see in the world

Re: Introducing ChatGPT and Whisper APIs

#568

> It is priced at $0.002 per 1k tokens, which is 10x cheaper than our existing GPT-3.5 models. This is a massive, massive deal. For context, the reason GPT-3 apps took off over the past few months before ChatGPT went viral is because a) text-davinci-003 was released and was a significant performance increase and b) the cost was cut from $0.06/1k tokens to $0.02/1k tokens, which made consumer applications feasible wit…

> I have no idea how OpenAI can make money on this. I did some quick calculation. We know the number of floating point operations per token for inference is approximately twice the number of parameters(175B). Assuming they use 16 bit floating point, and have 50% of peak efficiency, A100 could do 300 trillion flop/s(peak 624[0]). 1 hour of A100 gives openAI $0.002/ktok * (300,000/175/2/1000)ktok/sec * 3600=$6.1 back.…

The 600t performance is with sparsity in the spec. I think the price is nearly break even if sparsity is not used in the model.

Re: Introducing ChatGPT and Whisper APIs

#569
post #551
post #9

>Through a series of system-wide optimizations, we’ve achieved 90% cost reduction for ChatGPT since December This is seriously impressive. A MILLION tokens for 2 dollars is absolutely fucking insane. I hope that the gains reached here can also be found by open source and non-controlled AI projects. If so, that could be huge for the advancement of AI.

To be fair, it also seems like it performs worse. question: "Who is Scott Alexander?" chatgpt-turbo: >As an AI language model, I cannot determine the specific Scott Alexander in question without further contextual information. There may be several people with this name, including writers, politicians, entrepreneurs, athletes, and more. chatgpt website: >Scott Alexander is a pseudonym used by a prominent American psyc…

Perhaps a transitory issue. I just tried it with the API, `gpt-3.5-turbo`. I got:

> Scott Alexander is the pen name of American psychiatrist and blogger, Scott Alexander Siskind. He is known for writing his blog, "Slate Star Codex", which covers a wide range of topics including science, medicine, politics, and culture. He has been praised for his clear and concise writing style and thoughtful analysis of various issues. In addition to his work as a blogger, Scott Alexander has also published a book titled "Unsong", which is a fantasy novel set in an alternate universe where the Bible is a magical text.

Re: Introducing ChatGPT and Whisper APIs

#570

Earlier quoted context omitted.

Sure it would be called those things and then nothing would come of it. If a country uses morally compromised methods to win a war history just calls it winning the war.

That seems to be changing. I've seen an uptick in criticism against the usa for unnecessarily (according to top military advisors, experts, generals etc at the time) dropping the atom bomb on Japan for example.

Wouldn't stop anyone from doing it again if the stakes were high enough
Post reply on HN