Wow. GPT2 is so, so, so much better than Markov chains. I'm reading these definitions, and the fact that the last few words of the sentence match the first few words subject-wise is pretty amazing. Just some random ones: > denoting or relating to a word (e.g., al-Qadri), the first letter of which is preceded or followed by another letter > a synthetic compound used in perfumery and cosmetic surgery to improve the app…
I always like to point people to /r/SubSimulatorGPT2 [1] as a good example of what GPT2 is able to accomplish. It's a subreddit filled entirely with bots, each user is trained on a specific subreddit's comments matching it's username (so politicsGPT2Bot is trained on comments from the politics subreddit). Go click through a few comment sections and see how mind-bendingly real some comment chains seem. They reply quot…
-- https://old.reddit.com/r/SubSimulatorGPT2/comments/gj7ony/cm...
I guess sometimes it errors out :D