Live data from Hacker News

HyperTools: A Python toolbox for gaining insights into high-dimensional data

hypertools.readthedocs.io

21–26 of 26 posts

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#21

Earlier quoted context omitted.

Do you happen to know of a good graphing package for high dimensional data in R?

As far as I can tell, HyperTools are a bunch of convenience functions for doing something along the lines of the following dummy R code df %>% dim_reduction_function() %>% ggplot() + geom_*() So in a sense, I think you should be looking for a dimensionality reduction library, rather than a plotting library.

so it seems, looking at their gallery, and I'd rather just write the lines calling pca, or whatever.

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#23
post #19
post #15

Earlier quoted context omitted.

if you feel you need 3D, you've already failed to represent the data clearly Why?

I took a visualization course and to paraphrase the prof. you have a 3d object projected onto a 2d (display) plane and reasoning about depth gives additional mental load, not to mention occlusion. You have to interact with the model a lot to get a view you want. The course was based on old papers about UX with a dash of cognitive science, so take it with a grain of salt.

Yup, this. There's almost always a way to represent the data that allows clearer interpretation.

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#24
post #13

Quote of the day from HyperTools README https://github.com/ContextLab/hypertools "To deal with hyper-planes in a 14 dimensional space, visualize a 3D space and say "fourteen" very loudly. Everyone does it." -- Geoff Hinton

Don’t be silly. One can visualize the N-dimensional case and then it is just a matter of setting N=14.

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#25
post #2

Looks neat and wonderful. It’s always impossible to compress all structure from high dimensions to 2D or 3D via something like PCA or t-SNE, and the focus on “geometric” insight is also encouraging. Cool/appropriate name too, nice choice of well-supported dependencies, and minimalist design are all appealing. This could become a go-to toolkit for early stage exploration, while it’s also pretty and smart enough to wow…

Do you happen to know of a good graphing package for high dimensional data in R?

You should take a look at tourrr which implements a bunch of "grand tour" algorithms in R. These take your on a smooth tour of random projections of your data, visualised in various ways (including into 3d if you have some red-blue 3d glasses!)

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#26
post #25

Earlier quoted context omitted.

Do you happen to know of a good graphing package for high dimensional data in R?

You should take a look at tourrr which implements a bunch of "grand tour" algorithms in R. These take your on a smooth tour of random projections of your data, visualised in various ways (including into 3d if you have some red-blue 3d glasses!)

Interesting thanks
Post reply on HN