Earlier quoted context omitted.
Same here. I think the reason it bugs me so much is because my mind views it as a type error: int fewer; float less; is how I tend to remember the distinction. (Fortunately in my family, my wife is the language nerd who first called me on my misuse many years ago. Now I notice it everywhere too. It's weirdly viral.)
Fewer is for things that can be counted in numbers. Less is for non-numbered things. It's so easy that it really disturbs me when people get it wrong. Fewer people. Fewer zoos. Fewer cigarettes. Less hatred. Less abuse. Less misuse of power.
On another note, see how "fewer times" and "less time" means different things (might help clarify the distinction to some.)
(Non native speaker here though.)