Well, you know. You expect the violent person to be ashamed of themselves. That's a very bold assumption. A psychopath or sociopath won't feel a thing when they order their army to mow down peaceful protestors.
It's a beautiful idea really. But when you are given no option other than to fight, do you think it's wrong for them to do so? Jewish, Armenians, Chinese under Japanese occupation? Might have not mattered, might have. I guess it depends on the person. An exaggeration of course compared to the issue at hand, but it seems wishful idealism. In some cases, yes, it works. But when your adversary doesn't care, it's quite ineffective. Game-theory wise I think equal repercussion works quite well, where violence is met with violence in order to prevent it from happening. Sure not always, but if there is no punishment it's simply much too advantageous to use violence if it solves the problem.
I mean school bullies probably won't stop unless you hit them or they get some sort of punishment. Sure you'll feel probably mighty wise if you don't resort to violence or any kind of resistance, but it's unhelpful if it doesn't stop it. And in the meantime you'll be suffering tremendously.