Training a trillion parameter model to be funny
jokegen.sdan.io
Training a trillion parameter model to be funny
1–10 of 42 posts
Re: Training a trillion parameter model to be funny
#2Re: Training a trillion parameter model to be funny
#3Re: Training a trillion parameter model to be funny
#4It would be easier to judge this if the jokes weren't 90% about AI and silicon valley, understandable only to people who subscribe to astralcodexten
Re: Training a trillion parameter model to be funny
#5It would be easier to judge this if the jokes weren't 90% about AI and silicon valley, understandable only to people who subscribe to astralcodexten
Re: Training a trillion parameter model to be funny
#6They (the machines) had billboards/signage everywhere showing the estimated time left for humanity. A really good joke would lead the timer to grow (until they figured out how to produce the general patterns needed to both create and appreciate the joke).
Re: Training a trillion parameter model to be funny
#7these really aren't very funny
Re: Training a trillion parameter model to be funny
#8It would be easier to judge this if the jokes weren't 90% about AI and silicon valley, understandable only to people who subscribe to astralcodexten
[write a joke about thinking machines and the idea of tropes]
it's funny how enemies to lovers is a common trope that's uncommon in real life and lovers to enemies is an uncommon trope that's common in real lifeRe: Training a trillion parameter model to be funny
#9I once had a vivid dream that AI robots had taken over & were keeping humans around because they'd not yet mastered comedy. All of human culture globally was a comedy arms race with 24/7 open mic comedy jams on every corner. They (the machines) had billboards/signage everywhere showing the estimated time left for humanity. A really good joke would lead the timer to grow (until they figured out how to produce the gene…
Re: Training a trillion parameter model to be funny
#10We could not make it funny. Also interesting was that when CoT research was getting a lot of attention, we tried a joke version of CoT, asking GPT4 to explain why a joke was funny in order to produce training set data. Most of the explanations were completely off base.
After this work, I became a lot less worried about the GAI-taking-over narrative.
Funny is very, very hard.
[1] without a dictionary, which at first seems inefficient, but this work demonstrated that GPT could perfectly reconstruct the dictionary anyway