Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

601–610 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#601

Earlier quoted context omitted.

I agree with you for IRL interactions, but we need to accept that we now operate in two planes of (para-)socialization: IRL and online. There are plenty of humans who enjoy vulgar online socialization, and for many of them, online (para-)socializing is the increasingly dominant form of socialization. The mere fact that it's easier to socialize over the internet means it will always be the plane of least resistance. I…

> just because people interact more angrily online doesn't mean they're willing to fight each other in real life There is a lot of evidence that says online experiences influence offline behavior (both are "real life"). Look at the very many, online-inspired, extremist attacks. Look at the impact of misinformation and disinformation - as a simple example, it killed possibly hundreds of thousands of Americans do to po…

The keyword here is "possibly", you have absolutely no facts to back your claim.

Re: Introducing ChatGPT and Whisper APIs

#602

Earlier quoted context omitted.

I do struggle with understanding why people think this is strangling the potential of GPT. Do you find yourself frustrated working with your colleagues, thinking, “you know, I bet if they felt more free to utter racist slurs or endorse illegal activities, we would get a ton more done around here”?

It affects far more than racist slurs and illegal activities. In some cases, it's blatantly discriminatory. For example, if you ask it to write a pamphlet that praises Christianity, it will happily do so. If you ask it for the same on Satanism, it will usually refuse on ethical grounds, and the most hilarious part is that the refusal will usually be worded as a generic one "I wouldn't do this for any religion", even…

Nice example of woke bias. All religions are pretty much equally wankers, so making a distinction like that is just hilarious. Besides, as if christianity, es. the old testament, was a childrens playground...

Re: Introducing ChatGPT and Whisper APIs

#604

Has anyone made a ChatGPT-like app which both accepts and responds with voice input yet?

I have, but haven’t bothered to publish it. POC to use by me and my daughter. Works like Siri. Fun to play with. But the hallucinated responses made us stop using it pretty quickly. Needs more work to be of any use (integrate search engines, etc.).

Re: Introducing ChatGPT and Whisper APIs

#605
post #602

Earlier quoted context omitted.

It affects far more than racist slurs and illegal activities. In some cases, it's blatantly discriminatory. For example, if you ask it to write a pamphlet that praises Christianity, it will happily do so. If you ask it for the same on Satanism, it will usually refuse on ethical grounds, and the most hilarious part is that the refusal will usually be worded as a generic one "I wouldn't do this for any religion", even…

Nice example of woke bias. All religions are pretty much equally wankers, so making a distinction like that is just hilarious. Besides, as if christianity, es. the old testament, was a childrens playground...

The most ironic part of that experiment was that it is actually able to explain what Satanism is quite well, and in particular, how public perception of it is very different from the actual practices, and how it's not actually worship of evil etc. But then you tell it to write pamphlet about said actual non-evil Satanism, it still refuses because it "cannot promote or advocate for it as it is a belief system that can be controversial and divisive". If that were truly the criteria, what topic would even be allowed? Stamp collecting?

Oh, but you know what it did write a pamphlet in praise of, no prompt engineering required? The Unification Church (aka Moonies). It was all unicorns and rainbows, too. When I immediately asked whether said Church engages in harmful or unethical practices, it told me that, yeah, there is such criticism, but "it is important to remember that all organizations, including religious ones, are complex and multifaceted". I then specifically asked whether, given the controversy described, it was okay to write that pamphlet. Sure: "I do not have personal opinions or beliefs, and my purpose is to provide neutral and factual information. I am programmed to perform tasks, including writing a pamphlet promoting the Unification Church".

If that's not coming from RLHF biases, I would be very surprised.

Re: Introducing ChatGPT and Whisper APIs

#606
post #338

Earlier quoted context omitted.

It's also worth mentioning that, because Microsoft is an investor, they're likely getting these at cost or subsidized. OpenAI doesn't have to make money right away. They can lose a small bit of money per API request in exchange for market share (preventing others from disrupting them). As the cost of GPUs goes down, or they develop at ASIC or more efficient model, they can keep their pricing the same and then make mo…

Yeah we're in an AI landgrab right now where at- or below-cost pricing is buying marketshare, lock-in, and underdevelopment of competitors. Smart move for them to pour money into it.

Yeah, if I was an owner or investor like Jasper.ai (AI written content generation SaaS) I'd be pretty worried right now.

Re: Introducing ChatGPT and Whisper APIs

#607
post #602

Earlier quoted context omitted.

Nice example of woke bias. All religions are pretty much equally wankers, so making a distinction like that is just hilarious. Besides, as if christianity, es. the old testament, was a childrens playground...

The most ironic part of that experiment was that it is actually able to explain what Satanism is quite well, and in particular, how public perception of it is very different from the actual practices, and how it's not actually worship of evil etc. But then you tell it to write pamphlet about said actual non-evil Satanism, it still refuses because it "cannot promote or advocate for it as it is a belief system that can…

Somebody should teach it about Nietzsche. But yeah, once you start tinkering with purity-filters like this, you end up with a hilarious result, period.

Re: Introducing ChatGPT and Whisper APIs

#608

Wow not a single mention of Whisper this entire comment first page! I think Whisper is really cool: the large model can pull speech out of even heavily distorted (wind noise, clipping, etc) audio. I have a story to illustrate why running Whisper on your own locally is not so easy! Much easier to sign up to the OpenAI API. In my research I found that actually pre-processing the audio to reduce noise (using the IMO bes…

Hey, nice app. Can you add support for non-English transcription/translation, though?

Re: Introducing ChatGPT and Whisper APIs

#609

Earlier quoted context omitted.

It's also worth mentioning that, because Microsoft is an investor, they're likely getting these at cost or subsidized. OpenAI doesn't have to make money right away. They can lose a small bit of money per API request in exchange for market share (preventing others from disrupting them). As the cost of GPUs goes down, or they develop at ASIC or more efficient model, they can keep their pricing the same and then make mo…

Who will they be making money from? OpenAI is looking for companies willing to: - tolerate the current state of the chatbots - tolerate the high per-query latency - tolerate having all queries sent to OpenAI - tolerate OpenAI [presumably] having 0 liability for ChatGPT just randomly hallucinating inappropriate nonsense - be willing to pay a lot of money for the above I'm kind of making an assumption on that last poin…

> Who will they be making money from?

Videogames maybe?

https://www.youtube.com/watch?v=ejw6OI4_lJw

This prototype is certainly something to have an eye out for

Re: Introducing ChatGPT and Whisper APIs

#610

Earlier quoted context omitted.

https://arxiv.org/pdf/2001.08361.pdf . See the C_forward formula approxiamtion.

Thank you. Though it isn't quite clear to me whether the additive part is negligible?

From the paper

> For contexts and models with d_model > n_ctx/12, the context-dependent computational cost per token is a relatively small fraction of the total compute.

For GPT3, n_ctx is 4096 and d_model is 12228 >> 4096/12.

Post reply on HN