Live data from Hacker News

I've stopped using box plots (2021)

nightingaledvs.com

11–20 of 258 posts

Re: I've stopped using box plots (2021)

#11
Box plots make distributions easier to reason about by oversimplifying them. In a similar way, the mean can be very misleading (but we likely won't forbid its use!).

IMO a good takeaway might be to always use a plot that fairly represents the underlying distribution.

Re: I've stopped using box plots (2021)

#12
>box plots always make distributions look bell shaped

I feel like this is where the confusion stems from for the author and everyone else here. Box plots don't make anything bell shaped (they don't change the distribution), they assume that your data follows a bell/gaussian shape. This is correct in cases where the central limit theorem can be applied (which is almost everywhere) - but when that is not the case, the assumption is wrong and you shouldn't use a box plot anyways, because the values it shows have no real use. There are very real use cases for box plots, but people need to understand the basics of statistics before they can use them.

Re: I've stopped using box plots (2021)

#13

So the diagram should not be used because of an education problem with some audiences? Isn't that a bit like banning cars because some people can't drive? Some diagrams are simply not for mass consumption and this is one, particularly because it is designed to illustrate an interpretation of ranges instead of the direct/linear representation of the raw data. Of course I'd illustrate this fact as a Venn diagram compar…

[flagged]

Re: I've stopped using box plots (2021)

#14

>box plots always make distributions look bell shaped I feel like this is where the confusion stems from for the author and everyone else here. Box plots don't make anything bell shaped (they don't change the distribution), they assume that your data follows a bell/gaussian shape. This is correct in cases where the central limit theorem can be applied (which is almost everywhere) - but when that is not the case, the…

This should be the topmost comment. Box plots are made for visualizing generalized normal distributions and nothing else.

Edited to preempt nitpick.

Re: I've stopped using box plots (2021)

#15

>box plots always make distributions look bell shaped I feel like this is where the confusion stems from for the author and everyone else here. Box plots don't make anything bell shaped (they don't change the distribution), they assume that your data follows a bell/gaussian shape. This is correct in cases where the central limit theorem can be applied (which is almost everywhere) - but when that is not the case, the…

Exactly this on the last point. Although rereading this the distribution point is explained poorly.

People waltz in with assumptions and then complain when they don’t work because they don’t really understand the tools they are using. The author is one of them. It’s a bad article and the author should not be using or demonstrating things they clearly don't understand.

Re: I've stopped using box plots (2021)

#16
post #9

just use boxplots with an overlay of the actual data and any confusion goes away

This is the way to go in my opinion. I think it’s the easiest, most straight forward, and not confusing to the reviewer. You shouldn’t be using box plots to describe the shape of data to begin with, but having a ghost/after image/super imposition can probably only help in cases where you need to communicate that the shape is different, even if the statistical nature is the same.

Re: I've stopped using box plots (2021)

#17

So the diagram should not be used because of an education problem with some audiences? Isn't that a bit like banning cars because some people can't drive? Some diagrams are simply not for mass consumption and this is one, particularly because it is designed to illustrate an interpretation of ranges instead of the direct/linear representation of the raw data. Of course I'd illustrate this fact as a Venn diagram compar…

It's not like banning cars, it is like banning horse carriages on high ways.

We have better technology nowadays, including for plotting, so why not ditch the old?

The author of the blog post has some good arguments. From your post, I cannot distill an argument as to why you would prefer specifically a box plot over a strip plot.

Re: I've stopped using box plots (2021)

#19

>box plots always make distributions look bell shaped I feel like this is where the confusion stems from for the author and everyone else here. Box plots don't make anything bell shaped (they don't change the distribution), they assume that your data follows a bell/gaussian shape. This is correct in cases where the central limit theorem can be applied (which is almost everywhere) - but when that is not the case, the…

This should be the topmost comment. Box plots are made for visualizing generalized normal distributions and nothing else. Edited to preempt nitpick.

This is also wrong. Gaussian curves are symmetric. Box plots do not have to be. In fact representing skew in a batch is one of the fundamental purposes of them.

Re: I've stopped using box plots (2021)

#20
post #2

What about violin plots. https://en.m.wikipedia.org/wiki/Violin_plot

The author mentions those at the bottom of the article, but two problems highlighted still remain:

* There's another intermediary concept (kernel density estimation) between the audience and the data

* They're still likely to misrepresent tight groupings and discontinuities, which will be smoothed out

Post reply on HN