Mathematics is a language, but then why are you saying there was no Mathematics before Pythagoras? Obviously Pythagoras didn’t invent language! Long before Pythagoras people had been using language for doing and expressing computation.
Pāṇini did it. The Babylonians did it. It then took us a few thousand years to mechanize that knowledge and invent computers as we know them.
As for physics being “understandable” - I think you are conflating the ability to exploit nature with the ability to understand it.
Physics isn’t something “out there”. Available to birds and apes. It it is the body of knowledge (texts, ideas, concepts, formulas, narratives) instrumental to humans navigating nature.
There would be no physics without humans inventing it just like there would be no language without humans inventing it.
I am not at all concerned about the contents; or the structure of the pyramid. I am simply expressing a fact about the pyramid. That which people call science is not founded upon science. It is founded upon the liberal arts, humanities and social constructs (logic, philosophy, mathematics, computation, language) - the pyramid is founded upon human invention.