Earlier quoted context omitted.
Are you really asserting that these models aren't learning? What definition of learning are you using?
Do humans really read terabytes of C code to learn C? Humans look at a few examples and extrapolate…
But that also exists in the AI world. It’s called „fine tuning“: a LLM trained on a big general dataset can learn special knowledge with little effort.
I’d guess it’s exactly the same with humans: a human that received good general education can quickly learn specific things like C.