Earlier quoted context omitted.
Lots and lots of men speak almost exclusively in vocal fry, why is it so strongly associated with the Kardashians? Go listen to Jeremy Irons or Alan Rickman.
Honestly it's probably misogyny. There are some women we are supposed to hate who use it, so therefore it's bad to use it.
Some people have it at full volume and speed and that's just their voice. But a lot of people (and fewer men) it's not their real voice, but an affectation. We get to have opinions on people's affectations still, right?