The question "would space still exist if matter disappeared" is posed with an ontological bias which influences the answer. A better question is: does a universe in which there is nothing (and never has been) still contain space? (Though a better question, I wrecked it by introducing "never", which presupposes that the universe has time---even though it contains nothing, and therefore no events take place.) The quest…
Time is simply a measure of change, so if there is nothing to change how can there be time?
Think of the exact same system performing the same intra-system permutations (changes) but in two different reference frames (one relativistic and the other not). The changes are identical but the time required by each will be different due to their different reference frames. If time was simply a measure of change than you would expect the time taken by these two systems to be identical. Time then takes on a quality (or rather perhaps has a dependency) that exists beyond simply a "measure of change".