Without disputing that Asimov might have brought up such a concept somewhere in the series, it certainly is not a prime factor mentioned in the first novel.
"Good. Add to this the known probability of Imperial assassination, viceregal revolt, the contemporary recurrence of periods of economic depression, the declining rate of planetary explorations, the..."
[...]
Gaal said, "As Trantor becomes more specialized, it becomes more vulnerable, less able to defend itself. Further, as it becomes more and more the administrative center of Empire, it becomes a greater prize. As the Imperial succession becomes more and more uncertain, and the feuds among the great families more rampant, social responsibility disappears."