Earlier quoted context omitted.
That's a distinction without a difference. The majority of data is from a distribution that's already been sampled multiple times. E.g. how often does a baby go out and experience something novel? The majority of it's time is spent getting the same stimulus over and over again, as anyone listening to childrens television can attest. Humans learn in fundamentally different ways to our current systems and information p…
And what do you think epochs in machine learning are? Or why more modern training efforts (i.e. for LLMs) are focussing hard on deduplicating scraped data?
Why don't you tell me instead of asking questions that you surely know the answer for?