I hate Quanta a lot a vast amount of fluff for less than a college statistics professor would (hopefully) be able to impart with a chalkboard in 10 minutes, when Quanta has the ability to prepare animated diagrams like 3Blue1Brown but chooses not to use it they could go down myriad paths, like how it provides that random walks on square lattices are asymptotically isotropic, or give any other simple easy-to-understan…
The math that explains why bell curves are everywhere
11–20 of 133 posts
Re: The math that explains why bell curves are everywhere
#12Great article. Personally I have been learning more about the mathematics of beyond-CLT scenarios (fat tails, infinite variance etc) The great philosophical question is why CLT applies so universally. The article explains it well as a consequence of the averaging process. Alternatively, I’ve read that natural processes tend to exhibit Gaussian behaviour because there is a tendency towards equilibrium: forces, homeost…
As to ye philosophy of “why” the CLT gives you normals, my hunch is that it’s because there’s some connection between: a) the CLT requires samples drawn from a distribution with finite mean and variance and b) the Gaussian is the maximum entropy distribution for a particular mean and variance I’d be curious about what happens if you starting making assumptions about higher order moments in the distro
If I'm remembering it correctly it's interesting to think about the ramifications of that for the moments.
Re: The math that explains why bell curves are everywhere
#13He has several other related videos also.
https://www.youtube.com/@3blue1brown/search?query=convolutio...
Re: The math that explains why bell curves are everywhere
#14Hot take: bell curves are everywhere exactly because the math is simple. The causal chain is: the math is simple -> teachers teach simple things -> students learn what they're taught -> we see the world in terms of concepts we've learned. The central limit theorem generalizes beyond simple math to hard math: Levy alpha stable distributions when variance is not finite, the Fisher-Tippett-Gnedenko theorem and Gumbel/Fr…
We can use Calculus to do so much but also so little…
Re: The math that explains why bell curves are everywhere
#15Great article. Personally I have been learning more about the mathematics of beyond-CLT scenarios (fat tails, infinite variance etc) The great philosophical question is why CLT applies so universally. The article explains it well as a consequence of the averaging process. Alternatively, I’ve read that natural processes tend to exhibit Gaussian behaviour because there is a tendency towards equilibrium: forces, homeost…
As to ye philosophy of “why” the CLT gives you normals, my hunch is that it’s because there’s some connection between: a) the CLT requires samples drawn from a distribution with finite mean and variance and b) the Gaussian is the maximum entropy distribution for a particular mean and variance I’d be curious about what happens if you starting making assumptions about higher order moments in the distro
The most interesting assumptions to relax are the independence assumptions. They're way more permissive than the textbook version suggests. You need dependence to decay fast enough, and mixing conditions (α-mixing, strong mixing) give you exactly that: correlations that die off let the CLT go through essentially unchanged. Where it genuinely breaks is long-range dependence -fractionally integrated processes, Hurst parameter above 0.5, where autocorrelations decay hyperbolically instead of exponentially. There the √n normalization is wrong, you get different scaling exponents, and sometimes non-Gaussian limits.
There are also interesting higher order terms. The √n is specifically the rate that zeroes out the higher-order cumulants. Skewness (third cumulant) decays at 1/√n, excess kurtosis at 1/n, and so on up. Edgeworth expansions formalize this as an asymptotic series in powers of 1/√n with cumulant-dependent coefficients. So the Gaussian is the leading term of that expansion, and Edgeworth tells you the rate and structure of convergence to it.
Re: The math that explains why bell curves are everywhere
#16Hot take: bell curves are everywhere exactly because the math is simple. The causal chain is: the math is simple -> teachers teach simple things -> students learn what they're taught -> we see the world in terms of concepts we've learned. The central limit theorem generalizes beyond simple math to hard math: Levy alpha stable distributions when variance is not finite, the Fisher-Tippett-Gnedenko theorem and Gumbel/Fr…
Re: The math that explains why bell curves are everywhere
#17I hate Quanta a lot a vast amount of fluff for less than a college statistics professor would (hopefully) be able to impart with a chalkboard in 10 minutes, when Quanta has the ability to prepare animated diagrams like 3Blue1Brown but chooses not to use it they could go down myriad paths, like how it provides that random walks on square lattices are asymptotically isotropic, or give any other simple easy-to-understan…
A lot of times on HN when a math topic comes up that isn't about 3b1b, someone will jump in to say "this isn't as good as 3b1b". Last time I saw that, I was moved to comment: https://news.ycombinator.com/item?id=45800657 3b1b doesn't have the same goal as Quanta, or as introductory guides. It's actually not that great a teaching tool (it's truly great at what it is for, which is (a) appreciation and motivation, and (…
Re: The math that explains why bell curves are everywhere
#18Earlier quoted context omitted.
A lot of times on HN when a math topic comes up that isn't about 3b1b, someone will jump in to say "this isn't as good as 3b1b". Last time I saw that, I was moved to comment: https://news.ycombinator.com/item?id=45800657 3b1b doesn't have the same goal as Quanta, or as introductory guides. It's actually not that great a teaching tool (it's truly great at what it is for, which is (a) appreciation and motivation, and (…
there is no getting around that learning math requires actually having to buckle down and read and do math . A video will not suffice.
Re: The math that explains why bell curves are everywhere
#19Great article. Personally I have been learning more about the mathematics of beyond-CLT scenarios (fat tails, infinite variance etc) The great philosophical question is why CLT applies so universally. The article explains it well as a consequence of the averaging process. Alternatively, I’ve read that natural processes tend to exhibit Gaussian behaviour because there is a tendency towards equilibrium: forces, homeost…
As to ye philosophy of “why” the CLT gives you normals, my hunch is that it’s because there’s some connection between: a) the CLT requires samples drawn from a distribution with finite mean and variance and b) the Gaussian is the maximum entropy distribution for a particular mean and variance I’d be curious about what happens if you starting making assumptions about higher order moments in the distro
Re: The math that explains why bell curves are everywhere
#20I hate Quanta a lot a vast amount of fluff for less than a college statistics professor would (hopefully) be able to impart with a chalkboard in 10 minutes, when Quanta has the ability to prepare animated diagrams like 3Blue1Brown but chooses not to use it they could go down myriad paths, like how it provides that random walks on square lattices are asymptotically isotropic, or give any other simple easy-to-understan…
Seems a bit like Ted Talks. Lightweight popcorn for the simple minded.