> Why not pick 10^180 or something as the highest number/states then?
Because then we have to find all sorts of limits to all of our proofs, and qualify everything, and waste time proving that our results are under this limit? If we prove something about an algorithm parameterized by some N, and we rely on a Turing Machine in our proof, then we'd also have to figure out which N hits our limit of 10^180 states on the tape, so we can qualify the limits of our proof. This could be very difficult, since the translation to a Turing machine model can be arbitrarily complex. Why bother? It doesn't help anyone.
> To understand a finite computation, we (some amount of scientists and mathematicians) must understand at least ZFC?
Turing machines are for proving things about the nature of computation itself. You seem to be imagining that you need to understand Turing machines before you'll be allowed to make statements about some specific computation. That's simply not true. If Turing machines help you prove something, use them; if not, ignore them. Putting an arbitrary limit on them only makes them worse at proving things.
I'm not really sure why you're so focused on ZFC. On one hand, the vast majority of math proofs (and therefore CS proofs that are based on them) assume ZFC, usually without even bothering to mention it. On the other hand, the axiom of choice seems completely irrelevant for Turing machines. Although the tape is infinite, it's almost always implicitly assumed that the state is finite at every step (the rest of the tape is 0). You'd have to initialize the tape with some infinite pattern to get around this, and that's definitely out of the ordinary. It's probably better to think of the state as "arbitrarily large" rather than infinite. I suspect you could get away with assuming Peano arithmetic for most CS proofs anyone cares about.
But also, yes, some number of scientists and mathematicians are expected to understand the basic axioms of math if they're going to prove mathematical theorems.