This highly depends on where you live, what you've signed, and the precedent that exists in your locale.
In California, for example, non-competes are unenforceable whereas in other states they are. However, you may be sued for other reasons.
If you're well paid, go pay a lawyer to look through your employment contracts to learn how you could go about doing it.