Earlier quoted context omitted.
Auto-complete on steroids, is still my favorite analogy for AI. I don't mean that in a negative way either. Autocomplete is very good, but that never stopped me from learning English grammar and spelling.
The way I think of it has evolved a lot over the last 5 years. At this point I think human brains probably do something analogous to next token prediction when we think. For all the hype, I think LLMs are actually more , not less, intelligent than that average person realizes. I think it’s legit, actual intelligence, not just “artificial” intelligence. That may be a hot take but it’s just my perception.
If LLMs had shame, they'd surely not repeat mistakes (in the same context window) as much as they do.