Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Unrelated Words Puzzle

unrelatedwords.com

Post reply on HN
Print view View original

31–40 of 71 posts

Re: Unrelated Words Puzzle

#31

Post by duckqlz »

Comparing the first example against a similar guess based on intuition:

zuckerberg => investor(21%), mark(20%)

cuban => investor(3%), mark(%4)

Using google as a general guide to how often these words appear together

mark cuban => About 40,500,000 results on google

"mark cuban" => About 13,200,000 results on google

"mark" "cuban" => About 33,500,000 results on google

investor cuban => About 80,800,000 results on google

"investor cuban" => About 945 results on google

"investor" "cuban" => About 9,810,000 results on google

mark zuckerberg => About 41,700,000 results on google

"mark zuckerberg" => About 29,400,000 results on google

"mark" "zuckerberg" => About 35,700,000 results on google

investor zuckerberg => About 11,100,000 results on google

"investor zuckerberg" => About 479 results on google

"investor" "zuckerberg" => About 3,160,000 results on google

Considering the above results of how often the base words appear together and the added knowledge that Mark Cuban is more recognized for his investment activity than Zuckerberg I wonder how the relational scores are calculated by the game.

(Note: I realize this is nit-picking in an extreme sense but I found myself very interested in the underlying tech behind the game and this was part of my exploration so I thought I would share it with everyone else. Feel free to tear apart my methods I am still very interested in how the OP coded their solution)

Re: Unrelated Words Puzzle

#32

Post by nilstycho »

CrazyStat wrote: post #16
neilk wrote: post #5

I like it a lot, but it’s also frustrating. Perhaps it’s being hugged to death right now but the lookups are very slow, so when I disagree with the results it’s a bit painful. If the results were quicker it would not be so bad, I could try different things. I was a bit miffed that “currency” was not considered to be related to “mark”. Similarly I thought I’d found the perfect word between “ski” and “trust”, “mogul”,…

Exactly my feelings. The relatedness calculation needs to be an order of magnitude faster to make iterating on an idea fun. After seeing the Zuckerberg path I tried Cuban, which is not related to Mark or investor despite Mark Cuban being far more famous as an investor than Mark Zuckerberg.

"Cuban" was my first try. I'm surprised that "Zuckerberg" works so well given how poorly "Cuban" performs.

Re: Unrelated Words Puzzle

#33

Post by wakamoleguy »

duckqlz wrote: post #31

Comparing the first example against a similar guess based on intuition: zuckerberg => investor(21%), mark(20%) cuban => investor(3%), mark(%4) Using google as a general guide to how often these words appear together mark cuban => About 40,500,000 results on google "mark cuban" => About 13,200,000 results on google "mark" "cuban" => About 33,500,000 results on google investor cuban => About 80,800,000 results on googl…

I suspect this is because "cuban" has a lot of meaning in other contexts as well. If you see "cuban" out of context, one may think of Cuba or even sandwiches before thinking about Mark Cuban or other investors.

Re: Unrelated Words Puzzle

#34

Post by zeta0134 »

duckqlz wrote: post #31

Comparing the first example against a similar guess based on intuition: zuckerberg => investor(21%), mark(20%) cuban => investor(3%), mark(%4) Using google as a general guide to how often these words appear together mark cuban => About 40,500,000 results on google "mark cuban" => About 13,200,000 results on google "mark" "cuban" => About 33,500,000 results on google investor cuban => About 80,800,000 results on googl…

I'm irritated to learn that proper nouns are allowed. That's unusual for word games, and imho breaks the spirit of the thing. But honestly most of the frustration is not knowing whether the game is going to treat two words as related enough in advance. It doesn't feel like I'm being clever, it feels like I'm blindly exploring a graph.

Re: Unrelated Words Puzzle

#36

Post by [deleted] »

NiloCK wrote: post #21

See also https://enlinko.com/ . The calculations here are snappy. I do not know which one was created first. "Relatedness" here is according to ... something ... Approximately but not exactly the likelyhood that words appear near to one another in a large corpus of text. Probably doing lookups on something crunched by google books.

[deleted]

Re: Unrelated Words Puzzle

#37

Post by A_D_E_P_T »

xyztimm wrote: post #35

I put waves for radio and ocean and got 19% and 55%. Is my expectation that the first percentage should be higher off?

"Investment" --> "Capital"

Check. That worked.

"Capital" --> "Letter"

Did not work at all. And yet the two words are side-by-side with extreme frequency.

So, basically, I don't know how this game gauges relatedness. I do know that I don't like it.

Re: Unrelated Words Puzzle

#38

Post by pflats »

nilstycho wrote: post #32
CrazyStat wrote: post #16

Earlier quoted context omitted.

Exactly my feelings. The relatedness calculation needs to be an order of magnitude faster to make iterating on an idea fun. After seeing the Zuckerberg path I tried Cuban, which is not related to Mark or investor despite Mark Cuban being far more famous as an investor than Mark Zuckerberg.

"Cuban" was my first try. I'm surprised that "Zuckerberg" works so well given how poorly "Cuban" performs.

Zuckerberg almost always refers to one specific person; Cuban is a last name of an investor and also describes things related to the nation of Cuba.

Re: Unrelated Words Puzzle

#39

Post by bee_rider »

I got ocean->radio

My path:

Ocean-> waves -> amplitude -> radio

Solution path:

Ocean -> air —> radio

It seems odd that waves could be less closely related to radio than air.

I wonder if there’s some homonym issue with wave or something like that?

Edit:

Similarly, I got a random puzzle:

Heat -> Bar

“Pressure” seams like it ought to be a good guess. But apparently Heat and pressure are 29% related (ok! Seems reasonable). But bar and pressure are only 7% related despite a bar being a unit of pressure.

The solution was to add kilobar between bar and pressure, which is fine I guess.

Re: Unrelated Words Puzzle

#40

Post by omoikane »

kaesve wrote: post #13

How is relatedness measured? Using some embedding space? I often disagree with the measurements, the worst one being "punch" and "bowl" only relating 12%. The concept is very fun though. I might try to make my own version, as it also seems like a fun side project and a way to explore different word embedding spaces. Could be fun to maybe also have a visualization of the embedding space.

Per instructions, word similarities are computed using word vectors[1].

Note that the relatedness of words will depend on the training set. Many of these word2vec-based games uses data that was trained on Google News[2], so if "Unrelated Words" uses the same data, you should be looking for word pairs that are more common in news but perhaps less common in general text.

Semantle[3] is another game based on word vectors. I like "Unrelated Words" better because whereas Semantle requires guessing one fixed target word, which is often very different from its nearest neighbor, this game requires guessing a set of words, the flexibility of which makes it feel less frustrating.

[1] https://en.wikipedia.org/wiki/Word_embedding

[2] https://code.google.com/archive/p/word2vec/

[3] https://news.ycombinator.com/item?id=31588388

Post reply on HN