I think the people attempting to make technically true but scientifically uninteresting statements about population means often have ulterior political motives (which is why they don't do analyses that are actually scientifically interesting), so I don't think the outrage is always unjustified. This can be seen in their paper titles and abstracts, and particularly their press releases, which make typically claims about differences between groups unsupported by the data. There's a whole cottage industry of "men are like X, women are like Y" folks who are rather tendentiously misrepresenting data to sell their books.
In particular, that two populations have differing means is trivially true for nearly any two population groups and choice of traits, even randomly split ones, so simply demonstrating a population mean difference is nearly never interesting. If you choose any trait that can vary between people, and you manage to find every person in two finite population groups and compute a mean (so at this point you have zero sampling error, since you have a complete population count), the two means will very rarely be literally identical. There is some exact rational number that is "the average height of HN posters who registered on a January 2" and a rational number that is "the average height of HN posters who registered on a January 3", and these numbers are almost certainly different. Therefore demonstrating a difference in means is simply an exercise in getting a large enough sample size to prove something that is nearly always true. But going through the effort to collect the sample to "prove" that Jan-2nders are taller than Jan-3rders or vice-versa is not scientifically interesting, even though one of the two is almost certainly true. And it would certainly not be justified to hang much interpretation off my result, in which I speculated wildly about how evolutionary differences resulted in the Jan-3rders having (slightly) shorter height.
Now if you could show unexpectedly large differences, like many Jan-2nders are > 6ft while very few Jan-3rders are < 6ft, such that the population curves differ by more than a trivial amount, that could be an interesting result that merits further study. But then you need to be talking about distribution estimates and comparing curves and error bands, not talking about population means and quoting p-values.