Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: TensorSpace.js – Neural network 3D visualization framework

github.com

Post reply on HN
Print view View original

21–30 of 30 posts

Re: Show HN: TensorSpace.js – Neural network 3D visualization framework

#21

Post by syt123450 »

jamesonthecrow wrote: post #12

This looks really neat and it's definitely fun to play around with. I can't resist playing around with tools like this for a few minutes, but I've never really figured out what they're good for. What am I supposed to learn from them? What is the actionable information? That's not really a criticism, I just feel like I'm missing something.

TensorSpace provides structure information and some basic metric for deep learning, and we use these famous network to show what TensorSpace can do, and how to use TensorSpace API to construct networks. For deep learning experts, these famous network's information is really basic, but we hope TensorSpace can help others to understand existing model, or help to present customized models.

Re: Show HN: TensorSpace.js – Neural network 3D visualization framework

#22

Post by syt123450 »

andreyk wrote: post #15

Quite neat! Some constructive feedback - I think in addition to mouse controls, having keyboard 'spaceship' flying around is pretty important. I would also try to add model interprability tools (SmoothGrad) as an option, and perhaps contact some of those researchers to see how this can best be used for model understanding (I would guess visualizing grad flows / weights is more interesting than just layers). PS I actu…

Thanks so much for your suggestions. As you say, visualizing weights may be really helpful, and I get many feedbacks for adding visualizing weights. I will try to add this feature in later version of TensorSpace. Temporarily, TensorSpace integrate TrackballControl which is an plugin for Three.js to handle "space exploration", and I will try to add more keyboard event for TensorSpace.

I have viewed your blog, and it is really fun. However, it is a pity that the online demo is outdated. Could you tell me what technique you use to construct 3D scene? Thanks.

Re: Show HN: TensorSpace.js – Neural network 3D visualization framework

#23

Post by syt123450 »

p1esk wrote: post #14

To provide some feedback: 1. display weights and gradients (in addition to activations) 2. display how activations/weights/gradients change during training. For example, I should be able to point to checkpoint directory where my model is saved every epoch (or every few iterations), and then hit 'play' button to see how a particular feature map or weights filter is changing as I move between epochs/iterations. 3. disp…

Thanks for your feedback, I am planing to visualize weights in next version of TensorSpace. These days, I add a "live loader" for TensorSpace, user can use this API to visualize online training process.

And for others features, we are discussing how to integrate them with TensorSpace, looking forward to your further suggestions.

Re: Show HN: TensorSpace.js – Neural network 3D visualization framework

#24

Post by syt123450 »

breatheoften wrote: post #7

Is convolution transpose supported in this/tensorflow.js? Might be fun to visualize fully convolutional networks this way...

Yes, TensorSpace provides TransposeConv2d (https://tensorspace.org/html/docs/layerTranspose.html)

Re: Show HN: TensorSpace.js – Neural network 3D visualization framework

#25

Post by syt123450 »

ParanoidShroom wrote: post #2

Wow, this looks amazing. Going to check out how to process my model from keras to use with this tool. Doesn't like that complicated. Gonna give this a shot :) Great work !

Thanks. Visualize Keras model is easier than other kinds of model, as TensorSpace's API is designed based on Keras, you can easily use keras-like TensorSpace API to build TensorSpace model and visualize it.

Re: Show HN: TensorSpace.js – Neural network 3D visualization framework

#26

Post by syt123450 »

mendeza wrote: post #10

Would love to see this be vizualized in Augmented reality as well, like an ARKit app.

Augmented reality is really an amazing idea! As Three.js support web vr, I will dig into it. Hoping I can add this feature to TensorSpace soon.

Re: Show HN: TensorSpace.js – Neural network 3D visualization framework

#29

Post by syt123450 »

nerush wrote: post #3

Always wanted to visualize CNNs like this. I wonder whether it is possible to visualize RNNs at all.

I am trying to design RNN layers, however, RNN is not the same as CNN layers. Now we use 3D to visualize CNN layer, as RNN has a time level information, it required 4D to visualize it, but I will try my best to add this attractive feature to TensorSpace!

Re: Show HN: TensorSpace.js – Neural network 3D visualization framework

#30

Post by mendeza »

syt123450 wrote: post #26
mendeza wrote: post #10

Would love to see this be vizualized in Augmented reality as well, like an ARKit app.

Augmented reality is really an amazing idea! As Three.js support web vr, I will dig into it. Hoping I can add this feature to TensorSpace soon.

You should look into 8th wall, they are a startup that implemented really advanced AR on the browser!https://8thwall.com/products-web.html
Post reply on HN