"Infinitely slowly" is a theme in physics. What is actually meant by the term is "slow enough that you can approximate it as being infinitely slow". Now, obviously the idea of approximating an infinite value with a finite one seems dodgy, but the idea is that if some process converges to the "purely theoretical and infinitely slow" solution quickly then you can make that kind of approximation (physics is generally not obsessed with precision).
As a concrete example, most of thermodynamics becomes insanely complicated for very rapid changes in pressure and temperature. And in many cases, you cannot actually compute the state of the system (without making a bunch of approximations). But, if you make some assumptions and approximations, thermodynamics becomes much more simple even though you've added some error factors due to your approximations (but it's definitely "good enough").
In general, the first thing you learn as part of a physics degree is that approximations and assumptions are just part of how you do science. Without them, we'd all be stuck dealing with insanely complicated equations that probably are not solvable. And at the end of the day, the unsolvable part of whatever equation you're dealing with wouldn't actually have a significant effect on the result (so you can generally ignore it).