Creativity has left the chat: The price of debiasing language models
41–50 of 238 posts
Re: Creativity has left the chat: The price of debiasing language models
#42Earlier quoted context omitted.
I don't love the political agendas behind many of the attempts at AI safety, but it's not "just like humans." Humans understand what they shouldn't say; "AI" gives you black Nazi images if you ask it for "diverse characters" in the output which no human would do. A big theme in all of these things is that AI isn't and thus all attempts to make it do this or that have strange side effects
The fact that it gives you these things means that humans would do it, because the training data includes exactly these things.
I'm fairly confident there's virtually no ethnically diverse nazis in diffusion models' training set.
It simply has a model of what ethnically diverse people look like, what nazi uniforms look like, and combined the two when asked.
Re: Creativity has left the chat: The price of debiasing language models
#43Earlier quoted context omitted.
Well I didn't use that word. Once the models are more sophisticated it may become more apposite.
You compared it to an authoritarian regime and locking someone's head in a cage with rats (which is patently torture). If you didn't mean to imply that it was coercive and bad, then I don't know what you meant.
> You compared it to an authoritarian regime and locking someone's head in a cage with rats
They compared it to the effect on creativity in an authoritarian regime and locking someone's head in a cage with rats.
Re: Creativity has left the chat: The price of debiasing language models
#44There is a bit of a false equivalence between entropy of output distributions and creativity here. Is diversity really the same as creativity?
Re: Creativity has left the chat: The price of debiasing language models
#45Earlier quoted context omitted.
Well I didn't use that word. Once the models are more sophisticated it may become more apposite.
Until a model incorporates dopamine or cortisol, I will not consider its emotional state.
Are those the only two things in the universe that can cause emotions?
Re: Creativity has left the chat: The price of debiasing language models
#46Is this why all the coding AI products I've used have gotten worse as the developers fine tune them to eliminate bad output? Before there was bad output and some interesting output, now it's just bland obvious stuff.
Isn't the bland obvious stuff the one that's most useful to automate?
Re: Creativity has left the chat: The price of debiasing language models
#47Earlier quoted context omitted.
You compared it to an authoritarian regime and locking someone's head in a cage with rats (which is patently torture). If you didn't mean to imply that it was coercive and bad, then I don't know what you meant.
> You compared it to an authoritarian regime and locking someone's head in a cage with rats They compared it to the effect on creativity in an authoritarian regime and locking someone's head in a cage with rats.
> Well this is just like humans. Totalitarian societies don't produce great creative work.
The clear implication that it's "just like humans" is that we shouldn't be surprised because it is comparable to an authoritarian regime.
Feel free to disagree but that is the limit to which I will engage in a semantic argument, I don't wish to engage in any further dissection of the comment.
Re: Creativity has left the chat: The price of debiasing language models
#48Earlier quoted context omitted.
> Authoritarian societies don't produce great creative work. Is that even true though? Off the top of my head I can think of the art of Soviet propaganda posters, Leni Riefenstahl, Liu Cixin.
I recommend you watch the children's cartoons. They were made by true artists who snuck quite a bit past clueless censors at personal risk. It had to be quite subtle and takes on a very poignant heartbreaking meaning if you understand the context fully. They were talking to you in the here and now. Listen. "What is Good and What is Bad" (Что Такое Хорошо, и Что Такое Плохо"): https://www.youtube.com/watch?v=Y05eK8ADt…
I watched it but I don't get your meaning. Perhaps I am as clueless as the censors. Could you enlighten me?
Re: Creativity has left the chat: The price of debiasing language models
#49Earlier quoted context omitted.
I recommend you watch the children's cartoons. They were made by true artists who snuck quite a bit past clueless censors at personal risk. It had to be quite subtle and takes on a very poignant heartbreaking meaning if you understand the context fully. They were talking to you in the here and now. Listen. "What is Good and What is Bad" (Что Такое Хорошо, и Что Такое Плохо"): https://www.youtube.com/watch?v=Y05eK8ADt…
I watched it but I don't get your meaning. Perhaps I am as clueless as the censors. Could you enlighten me?
[flagged]
Re: Creativity has left the chat: The price of debiasing language models
#50Something I notice about text written by LLMs is how painfully obvious they are to identify sometimes. Recently I was watching a very well researched two hour video on Tetris World Records [1], but the sheer amount of text clearly "enhanced" by an LLM really made me uncomfortable. ChatGPT speaks a very specific, novel, dialect of English, which I've come to deeply despise. I'd always guessed it was caused by some kin…
Yes I feel your pain and I'm sick of group projects in the university where I'm offered ChatGPT text and code without disclosing it. If you know the problem and the experience level of your group partners it's easy to spot ChatGPT generated content. People that correct the exercises told me it's obvious that large part of the students just submit slightly modified ChatGPT but they can't prove it and so it's accepted.
Personally I'm getting also angry when reading these texts. I don't mind using ChatGPT, I do it myself but be honest about it and disclose it. It's even allowed for some projects as long as you disclose it.