Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Semantic Calculator (king-man+woman=?)

calc.datova.ai

Post reply on HN
Print view View original

71–80 of 179 posts

Re: Show HN: Semantic Calculator (king-man+woman=?)

#71

Post by Retr0id »

montebicyclelo wrote: post #51

> king-man+woman=queen Is the famous example everyone uses when talking about word vectors, but is it actually just very cherry picked? I.e. are there a great number of other "meaningful" examples like this, or actually the majority of the time you end up with some kind of vaguely tangentially related word when adding and subtracting word vectors. (Which seems to be what this tool is helping to illustrate, having bri…

I think it's slightly uncommon for the vectors to "line up" just right, but here are a few I tried:

actor - man + woman = actress

garden + person = gardener

rat - sewer + tree = squirrel

toe - leg + arm = digit

Re: Show HN: Semantic Calculator (king-man+woman=?)

#72

Post by dmonitor »

nxa wrote: post #16
nikolay wrote: post #4

Really?! man - brain = woman woman - brain = businesswoman

I probably should have prefaced this with "try at your own risk, results don't reflect the author's opinions"

I'm sure it would be trivial to get it to say something incredibly racist, so that's probably a worthwhile disclaimer to put on the website

Re: Show HN: Semantic Calculator (king-man+woman=?)

#73

Post by n2d4 »

thaumasiotes wrote: post #70
n2d4 wrote: post #68

Earlier quoted context omitted.

In the panel, you can drag one of the items (eg. Water) onto another one (eg. Earth), and it will create a new word (eg. Plant). It uses AI, so it goes very deep

No, that was the first thing I tried. The only thing that happens is that the two objects will now share their location. There are no interactions.

Probably a bug then, you can check YouTube to find videos of people playing it (eg. [0])

[0] https://youtu.be/8-ytx84lUK8

Re: Show HN: Semantic Calculator (king-man+woman=?)

#77

Post by groby_b »

montebicyclelo wrote: post #51

> king-man+woman=queen Is the famous example everyone uses when talking about word vectors, but is it actually just very cherry picked? I.e. are there a great number of other "meaningful" examples like this, or actually the majority of the time you end up with some kind of vaguely tangentially related word when adding and subtracting word vectors. (Which seems to be what this tool is helping to illustrate, having bri…

I think it's worth keeping in mind that word2vec was specifically trained on semantic similarity. Most embedding APIs don't really give a lick about the semantic space

And, worse, most latent spaces are decidedly non-linear. And so arithmetic loses a lot of its meaning. (IIRC word2vec mostly avoided nonlinearity except for the loss function). Yes, the distance metric sort-of survives, but addition/multiplication are meaningless.

(This is also the reason choosing your embedding model is a hard-to-reverse technical decision - you can't just transform existing embeddings into a different latent space. A change means "reembed all")

Re: Show HN: Semantic Calculator (king-man+woman=?)

#78

Post by neom »

cool but not enough data to be useful yet I guess. Most of mine either didn't have the words or were a few % off the answer, vehicle - road + ocean gave me hydrosphere, but the other options below were boat, ship, etc. Klimt almost made it from Mozart - music + painting. doctor - hospital + school = teacher, nailed it.

Getting to cornbread elegantly has been challenging.

Re: Show HN: Semantic Calculator (king-man+woman=?)

#79

Post by nbardy »

n2d4 wrote: post #64
godelski wrote: post #39

data + plural = number data - plural = research king - crown = (didn't work... crown gets circled in red) king - princess = emperor king - queen = kingdom queen - king = worker king + queen = queen + king = kingdom boy + age = (didn't work... boy gets circled in red) man - age = woman woman - age = newswoman woman + age = adult female body (tied with man) girl + age = female child girl + old = female child The other…

For fun, I pasted these into ChatGPT o4-mini-high and asked it for an opinion: data + plural = datasets data - plural = datum king - crown = ruler king - princess = man king - queen = prince queen - king = woman king + queen = royalty boy + age = man man - age = boy woman - age = girl woman + age = elderly woman girl + age = woman girl + old = grandmother The results are surprisingly good, I don't think I could've do…

I hate to be pedantic, but the llm is definitely doing embedding math. In fact that’s all it does.

Re: Show HN: Semantic Calculator (king-man+woman=?)

#80

Post by gweinberg »

godelski wrote: post #39

data + plural = number data - plural = research king - crown = (didn't work... crown gets circled in red) king - princess = emperor king - queen = kingdom queen - king = worker king + queen = queen + king = kingdom boy + age = (didn't work... boy gets circled in red) man - age = woman woman - age = newswoman woman + age = adult female body (tied with man) girl + age = female child girl + old = female child The other…

I got a bunch of red stuff also. I imagine the author cached embeddings for some words but not really all that many to save on credits. I gave it mermaid - woman and got merman, but when I tried to give it boar + woman - man or ram + woman - man, it turns out it has never heard of rams or boars.
Post reply on HN