Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

341–350 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#341

Earlier quoted context omitted.

It's amazing that "being two months out of date" in AI means that you are already a dinosaur

Besides HN, what other venues are popular for staying current on this topic?

I started /r/aigamedev as a subreddit to keep up to date on generative AI technologies, with a focus on the tech and workflows for gamedev. Its largely my own interest links as I research for work and personal, but its growing, and fluff free (so far).

Re: Introducing ChatGPT and Whisper APIs

#342

> It is priced at $0.002 per 1k tokens, which is 10x cheaper than our existing GPT-3.5 models. This is a massive, massive deal. For context, the reason GPT-3 apps took off over the past few months before ChatGPT went viral is because a) text-davinci-003 was released and was a significant performance increase and b) the cost was cut from $0.06/1k tokens to $0.02/1k tokens, which made consumer applications feasible wit…

> I have no idea how OpenAI can make money on this. I did some quick calculation. We know the number of floating point operations per token for inference is approximately twice the number of parameters(175B). Assuming they use 16 bit floating point, and have 50% of peak efficiency, A100 could do 300 trillion flop/s(peak 624[0]). 1 hour of A100 gives openAI $0.002/ktok * (300,000/175/2/1000)ktok/sec * 3600=$6.1 back.…

Note that they also charge equally for input and output tokens but, as far as I understand, processing inputs tokens is much computationally cheaper, which drops their price further.

Re: Introducing ChatGPT and Whisper APIs

#344

Earlier quoted context omitted.

I really wonder if one way they are able to make money on it is by monetizing all the data that pours into these products by the second.

The could probably live off of the NSA sponsoring alone.

Spot on

Re: Introducing ChatGPT and Whisper APIs

#346
The classic "Text completion" API (as opposed to the new "Chat completion" one) seems to offer more flexibility: You have complete freedom in providing interaction examples in the prompt (as in https://github.com/artmatsak/grace/blob/master/grace_chatbot...) and are not limited to the three predefined chat roles. But the requests being 10x cheaper means that we'll have to find ways around those limitations :)

Re: Introducing ChatGPT and Whisper APIs

#347

Earlier quoted context omitted.

> I have no idea how OpenAI can make money on this. I did some quick calculation. We know the number of floating point operations per token for inference is approximately twice the number of parameters(175B). Assuming they use 16 bit floating point, and have 50% of peak efficiency, A100 could do 300 trillion flop/s(peak 624[0]). 1 hour of A100 gives openAI $0.002/ktok * (300,000/175/2/1000)ktok/sec * 3600=$6.1 back.…

I really wonder if one way they are able to make money on it is by monetizing all the data that pours into these products by the second.

the only one making money on this is NVIDIA

Re: Introducing ChatGPT and Whisper APIs

#348
post #305

Earlier quoted context omitted.

All jobs will shift to asteroid mining.

AI is the perfect job for asteroid mining, or any other job outside of Earth orbit, whether for research or commerce. Space is incredibly hostile to humans and, short of some miracle technology, is likely to always remain so: at best we'll have a few plant-the-flag missions in the inner solar system.

I really wish we'd build a standarized space exploration platform and saturate the solar system with mostly-autonomous robots that occasionally phone home with "wtf is this?"

imagine all the surface area in the solar system. I bet there's got to be at least 100 completely unexpected things lying around that would transform our understanding.

Re: Introducing ChatGPT and Whisper APIs

#349

Earlier quoted context omitted.

I do struggle with understanding why people think this is strangling the potential of GPT. Do you find yourself frustrated working with your colleagues, thinking, “you know, I bet if they felt more free to utter racist slurs or endorse illegal activities, we would get a ton more done around here”?

Not anything racist or illegal but yes I find pc culture insufferable. It stifles creativity and most importantly reduces trust between parties. For context I am an Indian guy.

Politeness, lack of hate, etc. generally increase trust; that's much of their purpose. How do racial slurs increase trust?

How do you define "pc culture", and what specifically causes problems and how?

Attacking other people's beliefs as "insufferable", and aggressively demonstrating close-mindedness to them, tends to reduce trust.

Re: Introducing ChatGPT and Whisper APIs

#350

Earlier quoted context omitted.

This is a good thing. The future is curation and cultivation. We've been living in an age of information abundance and markets haven't adapted. The age of "crawl every website, index everything, and let people search it" is coming to an end. There is just too much content and too much of it is low quality. With or without AI. This abundance problem isn't just a WWW problem. Movies, TV, music, podcasts, short form con…

Why separate noise from signal? Why isn't AI-generated stuff seen just as valuable as human-written one? When you fill the world with plastic, you need to evolve to eat plastic. When you surround yourself with AI-produced stuff, then you should learn to respect it. First of all, evaluating someone based on what they wrote or said or did, is nonsense.

I think we agree. Humans can generate noise and AI can generate signal.
Post reply on HN