If you can't get the state to stop engaging in this, how are you going to get them to pass a law against it? Or not repeal the law the minute they want to do it again?
The incentive for states to do this is a direct consequence of progressive taxation. If a company paid $1000 in taxes and got back >=$1000 in police protection (or whatever), and the government's relationship with every other taxpayer was of the same nature, companies couldn't do this. The government actually can provide >$1000 in value for $1000 in tax revenue because government services can produce consumer surplus like anything else.
And if every taxpayer had that relationship with government then there would be no room for arbitrage. If someone wanted lower taxes, the cuts would have to come out of some services, but all the services provide as much taxpayer value as they cost. You can't attract high income taxpayers by cutting services that produce a net positive benefit to high income taxpayers.
The problem comes when one state wants to take from the rich and give to the poor and the next state doesn't, because then the richest people all move to the states that don't take more from them than they give back, and getting poorer people to move in instead is not what any state wants. Then the states that were trying to redistribute income realize they've failed, but they don't repeal the programs because they're very popular with the recipients, so instead they give the rich tax breaks to get them to come back. Because $1000 in tax revenue is more than zero, even if they were originally supposed to pay $10,000.
And so the programs that are supposed to redistribute income end up distributing it from the middle to the bottom instead of the top to the bottom and end up destroying the middle class.
The solution to this, at least between US states, is to have a UBI at the federal level and no other redistributive programs at all. Then the UBI serves the goal of redistribution and progressive taxes aren't required on top of that, so there is nothing for companies to arbitrage.