Live data from Hacker News

Ask HN: Would you read a statistics textbook?

news.ycombinator.com

41–50 of 70 posts

Re: Ask HN: Would you read a statistics textbook?

#41
Hi, I would read it if it came with a GitHub of python code that I can modify for my own use. The fewest dependencies, the better.

I like Statistical Rethinking, but unfortunately the solver was very slow and I didn't end up using it much - not the author's fault, it's probably my computer that's way too old.

Re: Ask HN: Would you read a statistics textbook?

#42
I've got a Bachelors and two Masters degrees in CS/Math, but yet I feel Probability and Statistics is my greatest weakness. I just cannot grok it / build an intuition for it, and believe me, I've tried. My biggest gripe with Prob/Stats textbooks is that it's very hard to explain things without needing to rely on measure theory.

Maybe probability and statistics are a skill issue on my behalf, but what I absolutely loathe is the absolute lack of standardisation when it comes to notation in measure theory. Every textbook does it differently. All of them assume that their notation is the one everyone uses. Nobody bothers to explain _what_ the notation means. If you ask me, every bit of new notation should be introduced with a sentence or two on "how to read this symbol in your head" - especially when there are indices, subscripts and superscripts involved. It's especially terrible for measure theory because there's so much "implicit" information you're supposed to gather from the context - but in a way I understand it, because if every bit of notation of absolute and complete, I imagine it would be quite hard to type up.

Anyways, my rant on measure theory notation aside - I would absolutely read yet another Prob/Stats textbook. But unfortunately I will also drop it really quickly if the author doesn't show me any "notation-sympathy" :)

Re: Ask HN: Would you read a statistics textbook?

#44
post #8

Earlier quoted context omitted.

Similar to an old idea I had about how every programming language needs three books: 1. Basic introduction. 2. Reference tome, which has absolutely everything. 3. Cookbook with style advice for the more advanced student, which assumes you've read 1 and can look up various details in 2. These days, 2 would be a wiki and 1 would likely be a bunch of pages on that wiki, but it's still good if you have someone sit down a…

Back in my day, the 3 books for programmers were Knuth vol 1, Knuth vol 2, and Knuth vol 3. ;)

Most german speakers will look back at the 2000 pages of "Java ist auch eine Insel" in terror, but it was actually all three books in one.

Re: Ask HN: Would you read a statistics textbook?

#45
post #8

No idea about statistics, but in most physict courses in my university, they recomend 3 books: 1) The main book, that has a complete explanation and is well ordered. It's for learning. 2) Tha Landau book, that is super short and hard. It's only to check you didn't miss any important formula or topic. 3) There Feynman book, that is anassorted colection of fairytales for physicist. It's a pleasure to read it but you mu…

Similar to an old idea I had about how every programming language needs three books: 1. Basic introduction. 2. Reference tome, which has absolutely everything. 3. Cookbook with style advice for the more advanced student, which assumes you've read 1 and can look up various details in 2. These days, 2 would be a wiki and 1 would likely be a bunch of pages on that wiki, but it's still good if you have someone sit down a…

I think you're describing the the Diátaxis framework [1], which would further split your (1) into fully guided tutorials and discursive explanations.

[1]: https://diataxis.fr/

Re: Ask HN: Would you read a statistics textbook?

#46
post #31
post #26

Earlier quoted context omitted.

How do you make 'reasonable judgements'? How do you tell whether someone else made reasonable judgements? How do you judge other people's intuition? Modelling distributions explicitly sounds nice, yes.

Look at the histogram and think about what distribution one could reasonably impute from samples. And what you would set as bounds for "outliers", per your needs. While we're at it, let me also say that it might be useful to specify outlier bounds not just based on the spread in sample values, but the costs/payoffs they imply for your application. If you are not doing something crazy, most reasonable people would agr…

>Look at the histogram and think about what distribution one could reasonably impute from samples. And what you would set as bounds for "outliers", per your needs. While we're at it, let me also say that it might be useful to specify outlier bounds not just based on the spread in sample values, but the costs/payoffs they imply for your application.

Only people with prior education/training in statistics are capable of doing this. The people who don't need a textbook.

Something like 60% of US adults read at or below the 6th grade level, and 25% of US adults struggle to comprehend graphs or charts entirely. Someone who has no idea what a standard deviation is can't intuit about distributions. I think you're dramatically overestimating the average person.

Re: Ask HN: Would you read a statistics textbook?

#47
Did you see that Andrew Gelman and others just published Bayesian Workflows? https://avehtari.github.io/Bayesian-Workflow/ It sounds similar to what you're after, away from describing the logic of models and the maths, instead it's about (quote from intro) 'There are all sorts of tacit knowledge in applied statistics that do not make it into published papers and textbooks. The present book is intended to put some of these ideas out in the open'

Where would your book fit into this?

Re: Ask HN: Would you read a statistics textbook?

#48
post #31
post #26

Earlier quoted context omitted.

How do you make 'reasonable judgements'? How do you tell whether someone else made reasonable judgements? How do you judge other people's intuition? Modelling distributions explicitly sounds nice, yes.

Look at the histogram and think about what distribution one could reasonably impute from samples. And what you would set as bounds for "outliers", per your needs. While we're at it, let me also say that it might be useful to specify outlier bounds not just based on the spread in sample values, but the costs/payoffs they imply for your application. If you are not doing something crazy, most reasonable people would agr…

Yup. And thinking through the physical realities or whatever real world constraints exist.

Re: Ask HN: Would you read a statistics textbook?

#49
post #31

Earlier quoted context omitted.

Look at the histogram and think about what distribution one could reasonably impute from samples. And what you would set as bounds for "outliers", per your needs. While we're at it, let me also say that it might be useful to specify outlier bounds not just based on the spread in sample values, but the costs/payoffs they imply for your application. If you are not doing something crazy, most reasonable people would agr…

>Look at the histogram and think about what distribution one could reasonably impute from samples. And what you would set as bounds for "outliers", per your needs. While we're at it, let me also say that it might be useful to specify outlier bounds not just based on the spread in sample values, but the costs/payoffs they imply for your application. Only people with prior education/training in statistics are capable o…

> Someone who has no idea what a standard deviation is can't intuit about distributions.

I disagree vehemently with this claim. I could cite my experience in teaching this topic to liberal arts / humanities college students in the US, but it is really more obvious than that. Anyone can understand a histogram easily and far more intuitively than they can understand the formula for a standard deviation and whether it must divide by N or N-1. Statistics courses and textbooks get stuck on that kind of pedantry, and most students end up missing the forest for the trees.

Re: Ask HN: Would you read a statistics textbook?

#50
post #17

My personal opinion is that statistics textbooks usually come from a prescriptive perspective, and that makes it challenging for the reader to get visceral intuition for what is actually going on. Any reader would be far better off just visualizing the damn distribution / samples and using reasonable judgement, instead of implicitly assuming a Gaussians distribution and blindly memorizing tests / formulae. Making the…

My larger issue, any time I have tried to learn statistics, is how fast the notation moves. You end up flipping back pages and pages just to double-check a definition that was given once and is now being extended syntactically. It's infuriating.
Post reply on HN