The amount of non-technical people who have very little intuition around the limitations of LLMs is actually fairly startling - and I like to think of myself of someone who is usually good at that kind of thing. The realistic/coherence of the output is just so convincing, people cannot seem to stop themselves from attributing a theory of mind to it. Just earlier this week I saw someone saying that they were creating…
How many people believe horoscopes and astrology carry any meaning? Most will never comprehend LLMs or even the simplest concepts of machine learning.
(Not to say those who believe in horoscopes and astrology know how it works though...)