i don't believe in physical limits for computation since beginning of 90ties when i read about 50MHz being the fundamental impossible to surpass limit and few years later i had DX4-133 running at home. Saying that with high appreciation for the grit of the people in the industry who has taken us that far and going to take even farther.
In practice the only real fundamental limit to how fast you can clock a processor has to do with the gate rise and fall times, which are in turn intimately coupled to how large those gates are (the main factor in determining their capacitance) and the resistance in the charging circuitry for the gate. This is essentially an RLC network where all of the dominant factors are parasitic. What the real practical limits are is as of yet unknown but you always have to keep in mind is that this is tech at the cutting edge and that what is impossible today may very well a breakthrough away from being common.