Earlier quoted context omitted.
You need more than a physical address, you need to live in estonia if you don't want to pay extra taxes. This is true for at least Finland, I have consulted tax lawyers about this.
I have explored quite a bit the idea of opening a company in Estonia via e-residency and this particular point of extra taxes never showed up. I am sure is not something that they would put on the first page, however I am a little surprise. Do you care to elaborate ?
Almost every country in the world taxes their residents' income, even if it arrives from a company abroad. And US (in)famously taxes their citizens' income, even if they do not live in US.
So if you run a company remotely, you still have to check with your local tax rules to see how much tax you may need to pay if this company pays you salary or dividend.