Earlier quoted context omitted.
I agree with you for IRL interactions, but we need to accept that we now operate in two planes of (para-)socialization: IRL and online. There are plenty of humans who enjoy vulgar online socialization, and for many of them, online (para-)socializing is the increasingly dominant form of socialization. The mere fact that it's easier to socialize over the internet means it will always be the plane of least resistance. I…
> just because people interact more angrily online doesn't mean they're willing to fight each other in real life There is a lot of evidence that says online experiences influence offline behavior (both are "real life"). Look at the very many, online-inspired, extremist attacks. Look at the impact of misinformation and disinformation - as a simple example, it killed possibly hundreds of thousands of Americans do to po…
Introducing ChatGPT and Whisper APIs
601–610 of 696 posts
Re: Introducing ChatGPT and Whisper APIs
#602Earlier quoted context omitted.
I do struggle with understanding why people think this is strangling the potential of GPT. Do you find yourself frustrated working with your colleagues, thinking, “you know, I bet if they felt more free to utter racist slurs or endorse illegal activities, we would get a ton more done around here”?
It affects far more than racist slurs and illegal activities. In some cases, it's blatantly discriminatory. For example, if you ask it to write a pamphlet that praises Christianity, it will happily do so. If you ask it for the same on Satanism, it will usually refuse on ethical grounds, and the most hilarious part is that the refusal will usually be worded as a generic one "I wouldn't do this for any religion", even…
Re: Introducing ChatGPT and Whisper APIs
#603Sorry if this is off topic but is there an extension that will read chatgpts replies out as a sound wav by a neural net wave like aws polly?
Re: Introducing ChatGPT and Whisper APIs
#604Has anyone made a ChatGPT-like app which both accepts and responds with voice input yet?
Re: Introducing ChatGPT and Whisper APIs
#605Earlier quoted context omitted.
It affects far more than racist slurs and illegal activities. In some cases, it's blatantly discriminatory. For example, if you ask it to write a pamphlet that praises Christianity, it will happily do so. If you ask it for the same on Satanism, it will usually refuse on ethical grounds, and the most hilarious part is that the refusal will usually be worded as a generic one "I wouldn't do this for any religion", even…
Nice example of woke bias. All religions are pretty much equally wankers, so making a distinction like that is just hilarious. Besides, as if christianity, es. the old testament, was a childrens playground...
Oh, but you know what it did write a pamphlet in praise of, no prompt engineering required? The Unification Church (aka Moonies). It was all unicorns and rainbows, too. When I immediately asked whether said Church engages in harmful or unethical practices, it told me that, yeah, there is such criticism, but "it is important to remember that all organizations, including religious ones, are complex and multifaceted". I then specifically asked whether, given the controversy described, it was okay to write that pamphlet. Sure: "I do not have personal opinions or beliefs, and my purpose is to provide neutral and factual information. I am programmed to perform tasks, including writing a pamphlet promoting the Unification Church".
If that's not coming from RLHF biases, I would be very surprised.
Re: Introducing ChatGPT and Whisper APIs
#606Earlier quoted context omitted.
It's also worth mentioning that, because Microsoft is an investor, they're likely getting these at cost or subsidized. OpenAI doesn't have to make money right away. They can lose a small bit of money per API request in exchange for market share (preventing others from disrupting them). As the cost of GPUs goes down, or they develop at ASIC or more efficient model, they can keep their pricing the same and then make mo…
Yeah we're in an AI landgrab right now where at- or below-cost pricing is buying marketshare, lock-in, and underdevelopment of competitors. Smart move for them to pour money into it.
Re: Introducing ChatGPT and Whisper APIs
#607Earlier quoted context omitted.
Nice example of woke bias. All religions are pretty much equally wankers, so making a distinction like that is just hilarious. Besides, as if christianity, es. the old testament, was a childrens playground...
The most ironic part of that experiment was that it is actually able to explain what Satanism is quite well, and in particular, how public perception of it is very different from the actual practices, and how it's not actually worship of evil etc. But then you tell it to write pamphlet about said actual non-evil Satanism, it still refuses because it "cannot promote or advocate for it as it is a belief system that can…
Re: Introducing ChatGPT and Whisper APIs
#608Wow not a single mention of Whisper this entire comment first page! I think Whisper is really cool: the large model can pull speech out of even heavily distorted (wind noise, clipping, etc) audio. I have a story to illustrate why running Whisper on your own locally is not so easy! Much easier to sign up to the OpenAI API. In my research I found that actually pre-processing the audio to reduce noise (using the IMO bes…
Re: Introducing ChatGPT and Whisper APIs
#609Earlier quoted context omitted.
It's also worth mentioning that, because Microsoft is an investor, they're likely getting these at cost or subsidized. OpenAI doesn't have to make money right away. They can lose a small bit of money per API request in exchange for market share (preventing others from disrupting them). As the cost of GPUs goes down, or they develop at ASIC or more efficient model, they can keep their pricing the same and then make mo…
Who will they be making money from? OpenAI is looking for companies willing to: - tolerate the current state of the chatbots - tolerate the high per-query latency - tolerate having all queries sent to OpenAI - tolerate OpenAI [presumably] having 0 liability for ChatGPT just randomly hallucinating inappropriate nonsense - be willing to pay a lot of money for the above I'm kind of making an assumption on that last poin…
Videogames maybe?
https://www.youtube.com/watch?v=ejw6OI4_lJw
This prototype is certainly something to have an eye out for
Re: Introducing ChatGPT and Whisper APIs
#610Earlier quoted context omitted.
https://arxiv.org/pdf/2001.08361.pdf . See the C_forward formula approxiamtion.
Thank you. Though it isn't quite clear to me whether the additive part is negligible?
> For contexts and models with d_model > n_ctx/12, the context-dependent computational cost per token is a relatively small fraction of the total compute.
For GPT3, n_ctx is 4096 and d_model is 12228 >> 4096/12.