Live data from Hacker News

Counterintuitive Properties of High Dimensional Space

marckhoury.github.io

21–30 of 68 posts

Re: Counterintuitive Properties of High Dimensional Space

#21

from the article: The volume of the unit d-sphere goes to 0 as d grows! A high dimensional unit sphere encloses almost no volume! Maybe I'm nitpicking, but this interpretation is not accurate IMO. Volume of N-dimensional sphere is measured is different units than that of (N-1)-dimensional sphere. E.g. one is m^5, and another is m^4. Comparing values measured in different units is not the best idea. It would be better…

That's what I thought reading that too. In general I don't think it's a good idea for maths people to just forget about units ("because it is for physics")

Re: Counterintuitive Properties of High Dimensional Space

#22

from the article: The volume of the unit d-sphere goes to 0 as d grows! A high dimensional unit sphere encloses almost no volume! Maybe I'm nitpicking, but this interpretation is not accurate IMO. Volume of N-dimensional sphere is measured is different units than that of (N-1)-dimensional sphere. E.g. one is m^5, and another is m^4. Comparing values measured in different units is not the best idea. It would be better…

The ‘pithy’ version of this idea is that most of a high-dimensional orange is the peel. It’s from this excellent article by Pedro Domingos: https://homes.cs.washington.edu/~pedrod/papers/cacm12.pdf

This is actually slightly different issue.

Regardless of the dimension, the volume of n-ball is V_n(r) = c_n * r^n, where r is radius, and c_n is a constant depending on n. The grandparent observation is that surprisingly enough, c_n goes (rather quickly) to 0 as n goes to infinity, so for unit n-ball, that is, a ball of radius 1, the volume is exactly c_n, which is very small. This is surprising to us, because in familiar case of n = 3, c_3 = 4/3 pi, which is moderately large.

As for the mass being concentrated around the peel, suppose we have an orange of radius R+e, and its peel has thickness of e. Then, the ratio of volume of the peel to the volume of the whole orange is exactly:

(V_n(R+e) - V_n(R))/V_n(R+e) = 1 - V_n(R)/V_n(R+e) = 1 - c_n R^n / c_n (R+e)^n = 1 - R^n/(R+e)^n = 1 - (R/(R+e))^n

Now, since R/(R+e) Note that the peel argument works just as well with "square" oranges -- they also have most of their mass concentrated around the peel, but contrary to round oranges, their whole mass does not go to 0 as the dimension increases. To see that, note that the volume of n-dimensional square with side of R is exactly R^n, and if you do the above computation, it's exactly the same (note that the constant c_n cancelled out anyway).

In this sense, your comment and the grandparent ones are about two different phenomenons -- grandparent is talking specificly about the geometry of the sphere in L_2 norm, while you are talking generally about n-dimensional volumes.

Re: Counterintuitive Properties of High Dimensional Space

#23

Earlier quoted context omitted.

It's a matter of one's individual intuition, but said ratio is a non-linear function, and non-linear functions most often are non-monotonous.

Except exponential, log, log-linear, sqrt, the time or space complexity of pretty much every problem in CS...

And all cumulative distribution functions, x^k where k is odd, all functions F(x) = integral(f(x') dx', -inf, x) where f(x) is continuous..

Re: Counterintuitive Properties of High Dimensional Space

#24
post #8
post #4

Just today on numberphile channel they showed how to pass circle through smaller square hole by bending it in higher (3rd) dimension: https://m.youtube.com/watch?v=AvFNCNOyZeE

The did a numberphile video on this exact topic a few months ago: https://www.youtube.com/watch?v=mceaM2_zQd8

The video you linked to has nothing at all to do with the parent one. You probably meant to reply to the topic, rather than the comment you actually replied to.

Re: Counterintuitive Properties of High Dimensional Space

#25
post #21

from the article: The volume of the unit d-sphere goes to 0 as d grows! A high dimensional unit sphere encloses almost no volume! Maybe I'm nitpicking, but this interpretation is not accurate IMO. Volume of N-dimensional sphere is measured is different units than that of (N-1)-dimensional sphere. E.g. one is m^5, and another is m^4. Comparing values measured in different units is not the best idea. It would be better…

That's what I thought reading that too. In general I don't think it's a good idea for maths people to just forget about units ("because it is for physics")

Speaking about math: I'm not even sure what the meaning of polynomial is. E.g. x^2+3x+1. Each component is measured in different units. Is it intuitive?

Re: Counterintuitive Properties of High Dimensional Space

#26
post #21

Earlier quoted context omitted.

That's what I thought reading that too. In general I don't think it's a good idea for maths people to just forget about units ("because it is for physics")

Speaking about math: I'm not even sure what the meaning of polynomial is. E.g. x^2+3x+1. Each component is measured in different units. Is it intuitive?

Such a polynomial only makes sense when x is a dimensionless quantity, or alternatively when the coefficients have appropriate dimensions to compensate.

Re: Counterintuitive Properties of High Dimensional Space

#27
post #8

Earlier quoted context omitted.

The did a numberphile video on this exact topic a few months ago: https://www.youtube.com/watch?v=mceaM2_zQd8

The video you linked to has nothing at all to do with the parent one. You probably meant to reply to the topic, rather than the comment you actually replied to.

I suspect you're wrong, and that the connection between video and parent was that they were both Numberphile videos. An expanded comment might have read something like:

"Not only is today's Numberphile video potentially relevant, Numberphile actually directly addressed the article's exact topic several months ago."

Re: Counterintuitive Properties of High Dimensional Space

#28
post #8

Earlier quoted context omitted.

The did a numberphile video on this exact topic a few months ago: https://www.youtube.com/watch?v=mceaM2_zQd8

The video you linked to has nothing at all to do with the parent one. You probably meant to reply to the topic, rather than the comment you actually replied to.

[deleted]

Re: Counterintuitive Properties of High Dimensional Space

#29
If you're interested in related problems, try improving on the performance of the wfg algorithm for computing the volume enclosed by a set of n-dimensional points. I spent a good 3 months convinced that I could, but I couldn't. The reason I couldn't is that I thought I could reason by analogy with 3D space, and it turns out that this is foolhardy.

Re: Counterintuitive Properties of High Dimensional Space

#30
post #26

Earlier quoted context omitted.

Speaking about math: I'm not even sure what the meaning of polynomial is. E.g. x^2+3x+1. Each component is measured in different units. Is it intuitive?

Such a polynomial only makes sense when x is a dimensionless quantity, or alternatively when the coefficients have appropriate dimensions to compensate.

The definition of a polynomial has nothing to do with units of measurement. The coefficients come from a ring and a ring has nothing g to do with units of measurement.
Post reply on HN