from the article: The volume of the unit d-sphere goes to 0 as d grows! A high dimensional unit sphere encloses almost no volume! Maybe I'm nitpicking, but this interpretation is not accurate IMO. Volume of N-dimensional sphere is measured is different units than that of (N-1)-dimensional sphere. E.g. one is m^5, and another is m^4. Comparing values measured in different units is not the best idea. It would be better…
Counterintuitive Properties of High Dimensional Space
21–30 of 68 posts
Re: Counterintuitive Properties of High Dimensional Space
#22from the article: The volume of the unit d-sphere goes to 0 as d grows! A high dimensional unit sphere encloses almost no volume! Maybe I'm nitpicking, but this interpretation is not accurate IMO. Volume of N-dimensional sphere is measured is different units than that of (N-1)-dimensional sphere. E.g. one is m^5, and another is m^4. Comparing values measured in different units is not the best idea. It would be better…
The ‘pithy’ version of this idea is that most of a high-dimensional orange is the peel. It’s from this excellent article by Pedro Domingos: https://homes.cs.washington.edu/~pedrod/papers/cacm12.pdf
Regardless of the dimension, the volume of n-ball is V_n(r) = c_n * r^n, where r is radius, and c_n is a constant depending on n. The grandparent observation is that surprisingly enough, c_n goes (rather quickly) to 0 as n goes to infinity, so for unit n-ball, that is, a ball of radius 1, the volume is exactly c_n, which is very small. This is surprising to us, because in familiar case of n = 3, c_3 = 4/3 pi, which is moderately large.
As for the mass being concentrated around the peel, suppose we have an orange of radius R+e, and its peel has thickness of e. Then, the ratio of volume of the peel to the volume of the whole orange is exactly:
(V_n(R+e) - V_n(R))/V_n(R+e) = 1 - V_n(R)/V_n(R+e) = 1 - c_n R^n / c_n (R+e)^n = 1 - R^n/(R+e)^n = 1 - (R/(R+e))^n
Now, since R/(R+e) Note that the peel argument works just as well with "square" oranges -- they also have most of their mass concentrated around the peel, but contrary to round oranges, their whole mass does not go to 0 as the dimension increases. To see that, note that the volume of n-dimensional square with side of R is exactly R^n, and if you do the above computation, it's exactly the same (note that the constant c_n cancelled out anyway).
In this sense, your comment and the grandparent ones are about two different phenomenons -- grandparent is talking specificly about the geometry of the sphere in L_2 norm, while you are talking generally about n-dimensional volumes.
Re: Counterintuitive Properties of High Dimensional Space
#23Earlier quoted context omitted.
It's a matter of one's individual intuition, but said ratio is a non-linear function, and non-linear functions most often are non-monotonous.
Except exponential, log, log-linear, sqrt, the time or space complexity of pretty much every problem in CS...
Re: Counterintuitive Properties of High Dimensional Space
#24Just today on numberphile channel they showed how to pass circle through smaller square hole by bending it in higher (3rd) dimension: https://m.youtube.com/watch?v=AvFNCNOyZeE
The did a numberphile video on this exact topic a few months ago: https://www.youtube.com/watch?v=mceaM2_zQd8
Re: Counterintuitive Properties of High Dimensional Space
#25from the article: The volume of the unit d-sphere goes to 0 as d grows! A high dimensional unit sphere encloses almost no volume! Maybe I'm nitpicking, but this interpretation is not accurate IMO. Volume of N-dimensional sphere is measured is different units than that of (N-1)-dimensional sphere. E.g. one is m^5, and another is m^4. Comparing values measured in different units is not the best idea. It would be better…
That's what I thought reading that too. In general I don't think it's a good idea for maths people to just forget about units ("because it is for physics")
Re: Counterintuitive Properties of High Dimensional Space
#26Earlier quoted context omitted.
That's what I thought reading that too. In general I don't think it's a good idea for maths people to just forget about units ("because it is for physics")
Speaking about math: I'm not even sure what the meaning of polynomial is. E.g. x^2+3x+1. Each component is measured in different units. Is it intuitive?
Re: Counterintuitive Properties of High Dimensional Space
#27Earlier quoted context omitted.
The did a numberphile video on this exact topic a few months ago: https://www.youtube.com/watch?v=mceaM2_zQd8
The video you linked to has nothing at all to do with the parent one. You probably meant to reply to the topic, rather than the comment you actually replied to.
"Not only is today's Numberphile video potentially relevant, Numberphile actually directly addressed the article's exact topic several months ago."
Re: Counterintuitive Properties of High Dimensional Space
#28Earlier quoted context omitted.
The did a numberphile video on this exact topic a few months ago: https://www.youtube.com/watch?v=mceaM2_zQd8
The video you linked to has nothing at all to do with the parent one. You probably meant to reply to the topic, rather than the comment you actually replied to.
Re: Counterintuitive Properties of High Dimensional Space
#29Re: Counterintuitive Properties of High Dimensional Space
#30Earlier quoted context omitted.
Speaking about math: I'm not even sure what the meaning of polynomial is. E.g. x^2+3x+1. Each component is measured in different units. Is it intuitive?
Such a polynomial only makes sense when x is a dimensionless quantity, or alternatively when the coefficients have appropriate dimensions to compensate.