I uninstalled Flash a few months ago and don't miss it. I mostly use Firefox, but I do keep Chrome around, so I could use Chrome's Flash if I wanted to, but I don't think I have so far. The only site I commonly visit that doesn't work is BBC News, funnily enough. It's a little annoying because it will work if I change the user agent to iPad, but instead I just don't watch BBC News videos.
I find that "click to play" works well enough. So it's always off by default, but you still have the option to make exceptions in the very rare cases where it's needed. I always wonder why is this not enabled by default in all majors browsers in fact.
My problem with click to play — which I used for a few years on Safari, Chrome, and Firefox, with extensions before it was built-in — is that your browser still reports to the website that you have Flash installed. At this point, most sites work without Flash, but only if the site thinks you don't have it. (Or, like Youtube, by requesting the HTML5 player in a setting.)