Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU • Hacker News Board

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#21

Post by sroussey » Tue, Jan 07, 2025, 11:37 PM UTC

Cieric wrote: post #16

I love the idea of this, but sadly I can't get it to work in Firefox, Chrome or Edge on my work pc, probably because I can't find "--enable-features=Vulkan" equivalent in the about:flags and the argument doesn't appear to work on windows. I'm actually a bit more curious about a standalone application that skips the webgpu part and goes straight to Vulkan as I would love to be able to experiment with some Cuda only ap…

I got a `Uncaught (in promise) TypeError: WebAssembly compilation aborted: Network error: Response body loading was aborted` error the first time, but after a reload it worked.

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#22

Post by grconner » Wed, Jan 08, 2025, 12:24 AM UTC

This is just amazing. So clean and straightforward. On a Mac just run it in Chrome see things work automagically. For real fun change the generations constant to 2000 and delete the usleep line to see this thing really cook.

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#23

Post by uncheckederror » Wed, Jan 08, 2025, 12:45 AM UTC

Impressed that this runs on my RX 6900XT (an RDNA2 GPU) in Chrome without any trouble. Very cool demo, excited to see how people leverage this capability.

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#24

Post by lights0123 » Wed, Jan 08, 2025, 12:47 AM UTC

doctoboggan wrote: post #14

lights0123 wrote: post #11

Earlier quoted context omitted.

I do do feature detection—WebGPU is blocked on Release Firefox regardless of config, you'll need nightly. It does support Safari with its experimental mode enabled for example.

I enabled WebGPU in safari on my m1 Mac and got this error when running the GoL demo: ``` TypeError: B.values().some is not a function. (In 'B.values().some(r=>r.args.length)', 'B.values().some' is undefined) ``` EDIT: I got the same error with all three sample scripts

I believe I just fixed this—JavaScriptCore doesn't have support for a recently-introduced function.

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#25

Post by samagra14 » Wed, Jan 08, 2025, 4:36 AM UTC

Sounds interesting! I love all these edge experiments. But as long as there is architecture dependent code for models, I feel these edge experiments can't fully express their strong suit.

You try to run something and Voila you need Ampere or Hopper or Laplace for flash attnt.

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#26

Post by mlepath » Wed, Jan 08, 2025, 4:51 AM UTC

This is really awesome. Tested it on both Nvidia and Mac GPUs.

Interested to know how debugging in a real application would work since WASM is pretty hard to debug and GPU code is pretty hard to debug. I assume WASM GPU is ... very difficult to debug.

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#27

Post by doctoboggan » Wed, Jan 08, 2025, 5:05 AM UTC

lights0123 wrote: post #24

doctoboggan wrote: post #14

Earlier quoted context omitted.

I enabled WebGPU in safari on my m1 Mac and got this error when running the GoL demo: ``` TypeError: B.values().some is not a function. (In 'B.values().some(r=>r.args.length)', 'B.values().some' is undefined) ``` EDIT: I got the same error with all three sample scripts

I believe I just fixed this—JavaScriptCore doesn't have support for a recently-introduced function.

I can confirm it is working for me now, thanks!

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#28

Post by Lockal » Wed, Jan 08, 2025, 6:36 AM UTC

Now I wonder how long will it take to add chipStar/Clspv/Tint to https://github.com/jhuber6/doomgeneric/tree/amdgpu and run DOOM on WebGPU this time.

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#29

Post by machinekob » Wed, Jan 08, 2025, 8:50 AM UTC

punnerud wrote: post #9

How performant is the CUDA code in browser compared to standalone program? Could we have PyTorch / ML training with CUDA through the browser performing ok?

WebGPU don't have access to most accelerators in GPU so it would be super slow compared to CUDNN version but pure CUDA would be only x times times faster.

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#30

Post by saagarjha » Wed, Jan 08, 2025, 9:42 AM UTC

punnerud wrote: post #9

How performant is the CUDA code in browser compared to standalone program? Could we have PyTorch / ML training with CUDA through the browser performing ok?

Well the bigger issue is that even natively I doubt there is enough performance to train anything interesting.