Well, once you go to low interest rates, you're effectively stuck with them.
See Japan. Low interest rates make it easy to take on more national debt, so you do. If Japan's bond yields would rise even to 2% (a still ridiculously low yield) then 100% of their tax revenue would go to debt service. They'd have nothing left to spend on actually running the government.
"Stubborn" Germany refusing to take on ludicrous levels of debt they don't need to "grow Europe out of their troubles" is the only thing keeping Europe out of this situation.
Our trillion+ yearly deficits can't go on much longer until we end up in a similar situation.
It's not like the central banks can just realize their mistakes and get out of low interest rates.
As a side note -- I'm very interested in how Japanese banks have survived this. US banks usually make more money the higher the interest rate is. European banks have REALLY struggled in the low interest environment, and US banks were looking pretty bad even when interest rates were only at 1%. Does anyone know how the Japanese banks are surviving?