Earlier quoted context omitted.
Exactly. I only have to worry about being declared a criminal by one rather than [arbitrary number] of groups that I have literally no control over.
You would have much more control over a competitive market of groups. Your claim is like saying that you'd rather there only be a single restaurant available rather than a group of restaurants, because then you only have to worry about one restaurant poisoning you or otherwise providing bad service.
If that's not how the libertarians envision it, and you can actually choose what government you want by actually moving into one governments influence (so you are without the influence of another) then what you describe is basically Europe. Is Europe the libertarian dream?
(Ironically, in Europe there is the problem of too many inhabitants of poor more liberal (corrupt/lawless) countries migrating to rich euro-socialist countries)