One of my physics lecturers at university made the offhand observation that the distinction between physics and mathematics is a twentieth-century idea : it wasn't made during the nineteenth century or before, and it seems to be disappearing in the twenty-first.
> it wasn't made during the nineteenth century That's because people were totally focused on physics, and math was just a useful tool sometimes. Doing physics was the true goal and observation the final arbiter of truth. Nowadays, that distinction is blurred but for the opposite reason; people think that anything conceived by sound math must be true, and observation has taken a back seat.
You can’t prove anything by observation. You can gather evidence through repeat experiment and become reasonably confident as your theory continues to not be incompatible with the observed universe. Then the problem of induction says, “well, it isn’t incompatible with the part of the universe… that you’ve observed, yet!” And then you say, “ok, but I want to use my theory to invent an iPhone, and I think there are enough people in the part of the universe that I’ve already observed. I looked very hard to find evidence against my theory, and I don’t think anyone will find evidence against it before I’ve sold enough iPhones to retire.”
Math, of course, is that stuff which can’t be invalidated by observations. But it is very hard to do enough math to retire off it.