Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

HiPlot: High-dimensional interactive plots made easy

ai.facebook.com

Post reply on HN
Print view View original

1–10 of 22 posts

Re: HiPlot: High-dimensional interactive plots made easy

#3

Post by sillysaurusx »

juliwu wrote: post #2

Does anyone know if this can be integrated with tensorboard.

Actually yeah, I wrote a script which 1. exports data from tensorboard.dev, then 2. prints it out in csv form that can be dropped into hiplot.

It was ok. Kind of lost interest when I saw the actual result. You can't smooth the data, so often times it's hard to tell what's going on.

Here's the awful script. It's specific to my own naming conventions, so it probably won't work for you. But the same idea would work: just parse the tensorboard data and spit it out as csv. https://gist.github.com/shawwn/b74d6e58da6496e2ade02bab61acc...

I also ran into a bug where multiple different datapoint types were getting merged into one. (It wasn't due to the csv code; the actual CSVs are fine.) I.e. the rows in the csv had a certain column that had a certain value, but in hiplot that column was nowhere to be found.

Here's what it looks like: https://imgur.com/1n1eDXu

I deployed an example here: https://hiplot-subsim-demo.now.sh

Notice that the "run" column shows up in the data, but not in hiplot.

Re: HiPlot: High-dimensional interactive plots made easy

#5

Post by keanzu »

We first chose to display only data points obtained after 20 or more epochs of training. Then, by slicing through the “loss” axis, we observed that larger learning rates led to better performance (perplexity). You can reproduce this example here:

https://facebookresearch.github.io/hiplot/_static/demo/ml1.c...

Re: HiPlot: High-dimensional interactive plots made easy

#7

Post by gavinray »

mbostock wrote: post #6

Based on a comment buried in the source, this library seems to be heavily based on work by Kai Chang: http://bl.ocks.org/syntagmatic/3150059 It’s a shame Kai isn’t created in the README, LICENSE, or announcement.

And Kai credits previous work from Jason Davies[0] and Mike Bostock[1]. Mike Bostock is the creator of D3.js and ObservableHQ.

[0] https://bl.ocks.org/jasondavies/1341281

[1] https://observablehq.com/@d3/parallel-coordinates

Edit: Just saw your name. Holy shit, it's Mike Bostock.

On a side tangent, I find it crazy that the New York Times for a long period had yourself, Jeremy Ashkenas, and Rich Harris all on staff. What an all-star team.

Re: HiPlot: High-dimensional interactive plots made easy

#8

Post by kovek »

gavinray wrote: post #7
mbostock wrote: post #6

Based on a comment buried in the source, this library seems to be heavily based on work by Kai Chang: http://bl.ocks.org/syntagmatic/3150059 It’s a shame Kai isn’t created in the README, LICENSE, or announcement.

And Kai credits previous work from Jason Davies[0] and Mike Bostock[1]. Mike Bostock is the creator of D3.js and ObservableHQ. [0] https://bl.ocks.org/jasondavies/1341281 [1] https://observablehq.com/@d3/parallel-coordinates Edit: Just saw your name. Holy shit , it's Mike Bostock. On a side tangent, I find it crazy that the New York Times for a long period had yourself, Jeremy Ashkenas, and Rich Harris all on staff.…

Mike Bostock (mbostock in this thread), D3.js is awesome!

Re: HiPlot: High-dimensional interactive plots made easy

#9

Post by mstade »

gavinray wrote: post #7
mbostock wrote: post #6

Based on a comment buried in the source, this library seems to be heavily based on work by Kai Chang: http://bl.ocks.org/syntagmatic/3150059 It’s a shame Kai isn’t created in the README, LICENSE, or announcement.

And Kai credits previous work from Jason Davies[0] and Mike Bostock[1]. Mike Bostock is the creator of D3.js and ObservableHQ. [0] https://bl.ocks.org/jasondavies/1341281 [1] https://observablehq.com/@d3/parallel-coordinates Edit: Just saw your name. Holy shit , it's Mike Bostock. On a side tangent, I find it crazy that the New York Times for a long period had yourself, Jeremy Ashkenas, and Rich Harris all on staff.…

You may already be aware of this, in which case I apologize for stating the obvious, but Mr. Bostock actually authored the comment you replied to. :o)

Re: HiPlot: High-dimensional interactive plots made easy

#10

Post by mbostock »

gavinray wrote: post #7
mbostock wrote: post #6

Based on a comment buried in the source, this library seems to be heavily based on work by Kai Chang: http://bl.ocks.org/syntagmatic/3150059 It’s a shame Kai isn’t created in the README, LICENSE, or announcement.

And Kai credits previous work from Jason Davies[0] and Mike Bostock[1]. Mike Bostock is the creator of D3.js and ObservableHQ. [0] https://bl.ocks.org/jasondavies/1341281 [1] https://observablehq.com/@d3/parallel-coordinates Edit: Just saw your name. Holy shit , it's Mike Bostock. On a side tangent, I find it crazy that the New York Times for a long period had yourself, Jeremy Ashkenas, and Rich Harris all on staff.…

Jeremy’s here at Observable, too!
Post reply on HN