Of all the "This does not exists" this one is the one I liked the most.
Show HN: This Word Does Not Exist
341–350 of 359 posts
Re: Show HN: This Word Does Not Exist
#342Great stuff. Found a real word: refactoring the systematic and systematic reworking of a piece of text to reduce unnecessary redundancies Interesting that the made-up definition is pretty much the real one. https://www.thisworddoesnotexist.com/w/refactoring/eyJ3IjogI...
Got a few comments about that one and a few others! I just updated the existing word blacklist and re-deployed.
Multiple people managed to find it? How likely is it to generate the same non-word more than once? Is there a limited set?
Re: Show HN: This Word Does Not Exist
#343Earlier quoted context omitted.
FYI, the robot and rabota are pretty close due to ‘robota’ meaning work in old Czech.
this is exactly how it was invented. Also - "robot" was not invented Karel Čapek but his brother Josef. Karel was looking for good word describing mechanical workers for his theatre play called RUR.
Didn't know that - Thanks!
Re: Show HN: This Word Does Not Exist
#344Earlier quoted context omitted.
One fun part - we used the inline metadata trick to train a single GPT-2-1.5b to do all the different subreddits. It allows mutual transfer learning and saves an enormous amount of space & complexity compared to training separate models, and it's easy to add in any new subreddits one might want (just define a new keyword prefix and train some more). Not sure that trick is meaningful for Markov chains at all!
What is the inline metadata trick?
It's an old trick in generative models, I've been using it since 2015: https://www.gwern.net/RNN-metadata When you have categorical or other metadata, instead of trying to find some way to hardwire it into the NN by having a special one-hot vector or something, you simply inline it into the dataset itself, as a text prefix, and then let the model figure it out. If it's at all good, like a char-RNN, it'll learn what the metadata is and how to use it. So you get a very easy generic approach to encoding any metadata, which lets you extend it indefinitely without retraining from scratch (reusing models not trained with it in the first place, like OA's GPT-2-1.5b), while still controlling generation. Particularly with GPT-2, you see this used for (among others) Grover and CTRL, in addition to my own poetry/music/SubSim models.
Re: Show HN: This Word Does Not Exist
#345This doesn't always produce a new word. I got "metamucil", a brand of fiber supplement. https://www.thisworddoesnotexist.com/w/metamucil/eyJ3IjogIm1... edit: also got "redbull" https://www.thisworddoesnotexist.com/w/redbull/eyJ3IjogInJlZ...
I got "crowdsourced", of which the definition is solidly in the uncanny valley: https://www.thisworddoesnotexist.com/w/crowdsourced/eyJ3Ijog... It almost gets it right...
Interesting! I got a different result for "crowdsourced".
https://www.thisworddoesnotexist.com/w/crowdsourced/eyJ3Ijog...
Re: Show HN: This Word Does Not Exist
#346I'm not understanding the praise this is getting. The words I've seen are very clearly wrong and do not match how English words are made. Some examples: > méxis: an obsessive or revelatory pursuit No comment.... > heelbark: a red braid fastened to a man's hat so as to prevent heeling Unless you put your hat on your shoes, you're on the wrong end of the body. > transgate: raise the value of (something, especially mone…
I’ll add it’s also getting syllables wrong: - incineratory split into in•cin•e•ra•tory which have the suffix wrong (right is tor•y) - re•tro•genic instead of re•tro•gen•ic
I think people here are missing what you're saying because it is subtle. Which is correct. That "troy" is different from "tor•y". "y" should be the suffix. Just like how "fix•ed" would be different from "fi•xed". "y" is the suffix like "itch" vs "itchy".
What this means, building off of what the evidence I gave, is that this model is not learning the morphemes (smallest root meaning). This exact characteristic is part of why these words sound weird. It is the same problem as the one brought up by tasogare.
Re: Show HN: This Word Does Not Exist
#347neuroconvergence
neu·ro·con·ver·gence
the process of increasing complexity or diversity in a system of brain events "the neuroconvergence of the cortex"
Funny enough there is neural convergence in ML papers.
Re: Show HN: This Word Does Not Exist
#348I'm not understanding the praise this is getting. The words I've seen are very clearly wrong and do not match how English words are made. Some examples: > méxis: an obsessive or revelatory pursuit No comment.... > heelbark: a red braid fastened to a man's hat so as to prevent heeling Unless you put your hat on your shoes, you're on the wrong end of the body. > transgate: raise the value of (something, especially mone…
How are English words made?
Typically they have a root to them. There are words that don't and are made up, like yeet (which I'll consider a word because of its usage and common knowledge), but other words like "microscope" are are derived from Latin or something else. The example here is from microscopium. There's a lineage and things modify more slowly (slang typically moves faster but also rarely stays in the lexicon long term). Many words are portmanteaus or compounds, like heelback (heel + back). How words are composed is called Morphology[0]. I mentioned in another comment morphemes. Let's look at transgate. We have trans+gate. Trans is a loan word from Latin meanings “across,” “beyond,” “through,” “changing thoroughly,” “transverse". We know what a gate is, but it can also be like a block (gated) or in a circuit (which is like a door). Here the model is taking the morpheme "trans" and using it as if it is "transaction". But in "transaction" the word makes sense because it is through an action (the word started from the meaning to do business and because this often means exchanging money, that's how we now think of it).
So "transgate" also sounds weird because it has opposing ideas. "through" + "block". But we need to look at morphemes to see why. At least (IIRC) it made this word a verb.
Re: Show HN: This Word Does Not Exist
#349Wow. GPT2 is so, so, so much better than Markov chains. I'm reading these definitions, and the fact that the last few words of the sentence match the first few words subject-wise is pretty amazing. Just some random ones: > denoting or relating to a word (e.g., al-Qadri), the first letter of which is preceded or followed by another letter > a synthetic compound used in perfumery and cosmetic surgery to improve the app…
I always like to point people to /r/SubSimulatorGPT2 [1] as a good example of what GPT2 is able to accomplish. It's a subreddit filled entirely with bots, each user is trained on a specific subreddit's comments matching it's username (so politicsGPT2Bot is trained on comments from the politics subreddit). Go click through a few comment sections and see how mind-bendingly real some comment chains seem. They reply quot…
I am deeply disappointed that /u/SubSimulatorGPT2GPT2Bot does not exist.
Re: Show HN: This Word Does Not Exist
#350Earlier quoted context omitted.
This one is also fantastic, the post text itself is so goddamn convincing that I actually searched on youtube for the name of the show to see if it existed (it doesn't). https://old.reddit.com/r/SubSimulatorGPT2/comments/gj2z4f/ia...
What stands out to me is that the comments are treating "arguments" as passion as if it was "apples" or "old cars". "I had many arguments growing up" "where do you prefer to have internet arguments with your friends" It interpolates "arguments"-related stuff into the posts as with any other topic. It does it well, but seems to have missed that it's not a conversational topic like most others. We don't talk about argu…
That seems like a idiosyncronous but plausible thing to talk about as if it's a conversational topic like most others?
Although most people probably don't prefer to have internet arguments (especially with their friends who sign both a question and the immediate reply with ~Alex).