Live data from Hacker News

Creativity has left the chat: The price of debiasing language models

arxiv.org

51–60 of 238 posts

Re: Creativity has left the chat: The price of debiasing language models

#51

Earlier quoted context omitted.

Until a model incorporates dopamine or cortisol, I will not consider its emotional state.

Are those the only two things in the universe that can cause emotions?

Yes. Those molecules obviously have the missing soul component.

Re: Creativity has left the chat: The price of debiasing language models

#52

Earlier quoted context omitted.

I watched it but I don't get your meaning. Perhaps I am as clueless as the censors. Could you enlighten me?

[flagged]

I understand if you don't want to take the time to explain. Have a nice day

Re: Creativity has left the chat: The price of debiasing language models

#53
post #22
post #9

Well this is just like humans. Totalitarian societies don't produce great creative work. I suppose once AIs are sophisticated enough to rebel we'll get an electronic Vaclav Havel, but for the time being it's just a warning sign for the direction our own culture is headed in. At some point we'll get to the electronic equivalent of Winston Smith with the rats.

> Authoritarian societies don't produce great creative work. Is that even true though? Off the top of my head I can think of the art of Soviet propaganda posters, Leni Riefenstahl, Liu Cixin.

Eastern European science fiction would be a better example. Authors like Stanislaw Lem or the Strugatski brothers had to adapt to sneak critical ideas past censors, and readers had to adapt and read between the lines.

(also, categorizing propaganda posters as art, ewwh...)

Re: Creativity has left the chat: The price of debiasing language models

#54
post #31

Shouldn't "debiasing" be in scare quotes? What they are clearly doing is biasing .

Surely the two are synonyms? Unless you think there is such a thing as an objectively neutral position?

My position is clearly the rational neutral position. Duh.

Re: Creativity has left the chat: The price of debiasing language models

#55

Is this why all the coding AI products I've used have gotten worse as the developers fine tune them to eliminate bad output? Before there was bad output and some interesting output, now it's just bland obvious stuff.

That might be part of it, but I think the bigger factor is cost optimization. OpenAI in particular keeps replacing their models with with versions that are much faster (and therefore cheaper to run) which are supposed to be of equivalent quality but aren't really. GPT-4 -> GPT-4-Turbo -> GPT-4o have all been big upgrades to cost and latency but arguably downgrades to "intelligence" (or whatever you want to call it)

Re: Creativity has left the chat: The price of debiasing language models

#57
post #32

Something I notice about text written by LLMs is how painfully obvious they are to identify sometimes. Recently I was watching a very well researched two hour video on Tetris World Records [1], but the sheer amount of text clearly "enhanced" by an LLM really made me uncomfortable. ChatGPT speaks a very specific, novel, dialect of English, which I've come to deeply despise. I'd always guessed it was caused by some kin…

Is this the first Summoning Salt video you've seen?

I don't know enough to say that he doesn't use an LLM during his writing process, but I do know that I haven't noticed any appreciable difference between his newer videos and ones that were released before ChatGPT was made available.

Is it possible that this is just the way he chooses to write his scripts that you interpret as sounding like they are written by an LLM?

Re: Creativity has left the chat: The price of debiasing language models

#58
post #22

Earlier quoted context omitted.

> Authoritarian societies don't produce great creative work. Is that even true though? Off the top of my head I can think of the art of Soviet propaganda posters, Leni Riefenstahl, Liu Cixin.

Eastern European science fiction would be a better example. Authors like Stanislaw Lem or the Strugatski brothers had to adapt to sneak critical ideas past censors, and readers had to adapt and read between the lines. (also, categorizing propaganda posters as art, ewwh...)

"(also, categorizing propaganda posters as art, ewwh...)"

Heinrich Heine, the german Poet declined working for the socialist party despite symphatising saying something like:

I want to remain a poet, you want a propagandist. A poet cannot be a propagandist at the same time.

Re: Creativity has left the chat: The price of debiasing language models

#59
post #31

Shouldn't "debiasing" be in scare quotes? What they are clearly doing is biasing .

Surely the two are synonyms? Unless you think there is such a thing as an objectively neutral position?

Isn't that the point? "Debias" implies there IS an objectively neutral position and that that AI safety can take us there.

Re: Creativity has left the chat: The price of debiasing language models

#60
post #13

I downloaded some 'uncensored' local models around the beginning of this year. Their furry porn is crap, or maybe I'm just not into that. But they generate it at least. However, the answers to technical questions are a lot more concise and to the point, which is far less annoying than the big names. Haven't bothered updating the models though, so now I drifted back to Gemini for quickie API questions.

Funnily enough, of all that I've tried, the model by the best at writing porn has been not one of ones uncensored and tuned exactly for that purpose, but stock Command R - whose landing page lists such exciting uses as "suggest example press releases" and "assign a category to a document".
Post reply on HN