Show HN: Keep your PyTorch model in VRAM by hot swapping code

We use python notebooks for that functionality in the early stages of script testing. Load a cell up top with the model, then do your stuff below, and once things look good convert it to a normal python script.

Re: Show HN: Keep your PyTorch model in VRAM by hot swapping code

#7

Post by [deleted] » Mon, Apr 21, 2025, 5:42 AM UTC

[deleted]

Re: Show HN: Keep your PyTorch model in VRAM by hot swapping code

#8

Post by kombine » Mon, Apr 21, 2025, 6:30 AM UTC

valine wrote: post #5

pizza wrote: post #4

Tensor visualizer app itself already looks pretty interesting

Thanks, I will do a deep writeup on that at some point.

Are you running both DearImGui visualisation and training locally? If not, how can one use it in the client-server mode? I think this is the most common requirement for visualisation libraries in Deep Learning.

Re: Show HN: Keep your PyTorch model in VRAM by hot swapping code

#9

Post by valine » Mon, Apr 21, 2025, 6:40 AM UTC

kombine wrote: post #8

valine wrote: post #5

Earlier quoted context omitted.

Thanks, I will do a deep writeup on that at some point.

Are you running both DearImGui visualisation and training locally? If not, how can one use it in the client-server mode? I think this is the most common requirement for visualisation libraries in Deep Learning.

The rendering is done with OpenGL, and for remote viewing I just render to an offscreen framebuffer and stream it back to the client with WebRTC. The code for that isn’t public yet, still needs some cleanup.

Re: Show HN: Keep your PyTorch model in VRAM by hot swapping code

#10

Post by iaw » Mon, Apr 21, 2025, 1:21 PM UTC

pizza wrote: post #4

Tensor visualizer app itself already looks pretty interesting

Yeah, sadly the link to their visualizations is gated behind X.com