Viewing profile — voooduuuuu

Ask an LLM to invent a new word and post it here. You will see that it simply combines words already in the training data.

Ask an LLM to invent a new word and post it here, I will be waiting. You will see that it simply combines words already in the training data.

I think you are conflating composition and prediction. LLMs don't compose higher abstractions from the "axioms, symbols and rules", they simply predict the next token, like a reall…