Live data from Hacker News

Show HN: This Word Does Not Exist

thisworddoesnotexist.com

241–250 of 359 posts

Re: Show HN: This Word Does Not Exist

#241
post #153

Earlier quoted context omitted.

Wow, this is so much better than the original /r/subredditsimulator (which was Markov Chains). That's a very fun thread you linked - it's very believable!

One fun part - we used the inline metadata trick to train a single GPT-2-1.5b to do all the different subreddits. It allows mutual transfer learning and saves an enormous amount of space & complexity compared to training separate models, and it's easy to add in any new subreddits one might want (just define a new keyword prefix and train some more). Not sure that trick is meaningful for Markov chains at all!

What is the inline metadata trick?

Re: Show HN: This Word Does Not Exist

#246
Seems like it failed?

headbutter. One who strikes other people with one's head. You are becoming known as a headbutter, so unless you want the league to suspend you, I suggest that you stop playing dirty! Headbutter - Idioms by The Free Dictionary https://idioms.thefreedictionary.com/headbutter

Re: Show HN: This Word Does Not Exist

#248

Earlier quoted context omitted.

Oh no, it must have missed my blacklist. It's supposed to give a little "this word probably exists" when that happens. It's surprisingly hard to determine if a word already exists: https://www.thisworddoesnotexist.com/w/tissue/eyJ3IjogInRpc3...

Is there any sort of logic to discourage it from using a word in its own definition as it does there?

Not currently, but I should probably reject samples that do! Filed a task here: https://github.com/turtlesoupy/this-word-does-not-exist/issu...

Re: Show HN: This Word Does Not Exist

#250

Wow. GPT2 is so, so, so much better than Markov chains. I'm reading these definitions, and the fact that the last few words of the sentence match the first few words subject-wise is pretty amazing. Just some random ones: > denoting or relating to a word (e.g., al-Qadri), the first letter of which is preceded or followed by another letter > a synthetic compound used in perfumery and cosmetic surgery to improve the app…

I always like to point people to /r/SubSimulatorGPT2 [1] as a good example of what GPT2 is able to accomplish. It's a subreddit filled entirely with bots, each user is trained on a specific subreddit's comments matching it's username (so politicsGPT2Bot is trained on comments from the politics subreddit). Go click through a few comment sections and see how mind-bendingly real some comment chains seem. They reply quot…

Wow. Now I really wish they had released a pretrained GPT2 model.
Post reply on HN