Live data from Hacker News

HyperTools: A Python toolbox for gaining insights into high-dimensional data

hypertools.readthedocs.io

1–10 of 26 posts

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#2
Looks neat and wonderful. It’s always impossible to compress all structure from high dimensions to 2D or 3D via something like PCA or t-SNE, and the focus on “geometric” insight is also encouraging. Cool/appropriate name too, nice choice of well-supported dependencies, and minimalist design are all appealing. This could become a go-to toolkit for early stage exploration, while it’s also pretty and smart enough to wow a coworker / investor. Hope it continues to really develop conceptually and practically!

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#3
post #2

Looks neat and wonderful. It’s always impossible to compress all structure from high dimensions to 2D or 3D via something like PCA or t-SNE, and the focus on “geometric” insight is also encouraging. Cool/appropriate name too, nice choice of well-supported dependencies, and minimalist design are all appealing. This could become a go-to toolkit for early stage exploration, while it’s also pretty and smart enough to wow…

Do you happen to know of a good graphing package for high dimensional data in R?

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#4
The first example

http://hypertools.readthedocs.io/en/latest/auto_examples/plo...

seems a little disappointing -- it seems to exemplify more than solve the problems of representing 3D data on a 2D screen. (Is it interactively rotatable or something? I did run it locally in a notebook and it didn't appear to be.)

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#5

The first example http://hypertools.readthedocs.io/en/latest/auto_examples/plo... seems a little disappointing -- it seems to exemplify more than solve the problems of representing 3D data on a 2D screen. (Is it interactively rotatable or something? I did run it locally in a notebook and it didn't appear to be.)

Indeed, all the examples appear to be showing datasets that would benefit from good data visualisation and in some cases dimension reduction, but all of them are terribly represented. I don't think this necessarily a problem with the library, but the examples certainly do not exemplify good visualisation of high-dimensional data.

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#6
post #2

Looks neat and wonderful. It’s always impossible to compress all structure from high dimensions to 2D or 3D via something like PCA or t-SNE, and the focus on “geometric” insight is also encouraging. Cool/appropriate name too, nice choice of well-supported dependencies, and minimalist design are all appealing. This could become a go-to toolkit for early stage exploration, while it’s also pretty and smart enough to wow…

Do you happen to know of a good graphing package for high dimensional data in R?

Good visualisation of high dimensional data is almost all about the mental model and mapping of dimensions, barely ever about the library. ggplot2 is excellent for displaying high dimensional data in R if you can reason well about your own data. If you can't, no library is going to save you.

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#7
post #6

Earlier quoted context omitted.

Do you happen to know of a good graphing package for high dimensional data in R?

Good visualisation of high dimensional data is almost all about the mental model and mapping of dimensions, barely ever about the library. ggplot2 is excellent for displaying high dimensional data in R if you can reason well about your own data. If you can't, no library is going to save you.

Well I already use ggplot. I'm not sure ggplot does 3D much.... About the reasoning, well who knows.

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#8
I can't see anything in the tutorials or examples that makes this a good library for visualisation of high-dimensional data. It seems somewhat equivalent to base graphics in R, which is much less useful for visualising high-dimensional data than anything based on Wilkinson's grammar of graphics, like ggplot2 in R.

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#9
post #6

Earlier quoted context omitted.

Good visualisation of high dimensional data is almost all about the mental model and mapping of dimensions, barely ever about the library. ggplot2 is excellent for displaying high dimensional data in R if you can reason well about your own data. If you can't, no library is going to save you.

Well I already use ggplot. I'm not sure ggplot does 3D much.... About the reasoning, well who knows.

If you present an example of high-dimensional data I'd be happy to help you reason about how to visualise it (although this is perhaps better suited to StackExchange).

edit: if you feel you need 3D, you've already failed to represent the data clearly

Re: HyperTools: A Python toolbox for gaining insights into high-dimensional data

#10
post #9

Earlier quoted context omitted.

Well I already use ggplot. I'm not sure ggplot does 3D much.... About the reasoning, well who knows.

If you present an example of high-dimensional data I'd be happy to help you reason about how to visualise it (although this is perhaps better suited to StackExchange). edit: if you feel you need 3D, you've already failed to represent the data clearly

[deleted]
Post reply on HN