I accept them for a few messaging apps, where they're truly useful enough that it balances out the inconvenience of saying no to the many sites that have no business asking.
I think browsers would do well to let users whitelist some sites and pretend to all others that the capability isn't available.