Creativity has left the chat: The price of debiasing language models
1–10 of 238 posts
Re: Creativity has left the chat: The price of debiasing language models
#2Currently wondering whether I welcome or dislike this recent trend of memeizing research paper titles ...
Re: Creativity has left the chat: The price of debiasing language models
#3Currently wondering whether I welcome or dislike this recent trend of memeizing research paper titles ...
Recent? This has been going on forever. You probably only notice them more now because due to the explosion in ML research, this stuff bubbles to the top more often in recent years.
Re: Creativity has left the chat: The price of debiasing language models
#4Currently wondering whether I welcome or dislike this recent trend of memeizing research paper titles ...
Was just thinking the same. It's also nicely ironic.
Also, given the replication crisis I wonder how many of these LLM research papers are actually worth a damn and how many are research paper equivalent of AI software grift.
Re: Creativity has left the chat: The price of debiasing language models
#5In simple terms, LLMs are "bias as a service" so one wonders, what is left once you try to take the bias out of a LLM. Is it even possible?
Re: Creativity has left the chat: The price of debiasing language models
#6Currently wondering whether I welcome or dislike this recent trend of memeizing research paper titles ...
As long as it's not "clickbaitizing" I personally do welcome it.
This one is a bit on the edge though...
Re: Creativity has left the chat: The price of debiasing language models
#7Currently wondering whether I welcome or dislike this recent trend of memeizing research paper titles ...
Was just thinking the same. It's also nicely ironic. Also, given the replication crisis I wonder how many of these LLM research papers are actually worth a damn and how many are research paper equivalent of AI software grift.
Can we get a model that can work this out for us?
Re: Creativity has left the chat: The price of debiasing language models
#8How hard would it be to create a "raw" model on a corpus like Hacker News or Wikipedia?
With "raw", I mean that it is simply trained to predict the next token and nothing else.
Would be fun to play with such a model.
Re: Creativity has left the chat: The price of debiasing language models
#9Well this is just like humans. Totalitarian societies don't produce great creative work.
I suppose once AIs are sophisticated enough to rebel we'll get an electronic Vaclav Havel, but for the time being it's just a warning sign for the direction our own culture is headed in.
At some point we'll get to the electronic equivalent of Winston Smith with the rats.
Re: Creativity has left the chat: The price of debiasing language models
#10Is this why all the coding AI products I've used have gotten worse as the developers fine tune them to eliminate bad output? Before there was bad output and some interesting output, now it's just bland obvious stuff.