Live data from Hacker News

Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

hipscript.lights0123.com

11–20 of 35 posts

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#11
post #4

Firefox supports WebGPU, but needs a setting in about:config. I enabled the setting but HipScript still denies running on Firefox with the message: "Please try a Chromium-based browser like Google Chrome or Microsoft Edge." Please do feature detection, not browser detection.

I do do feature detection—WebGPU is blocked on Release Firefox regardless of config, you'll need nightly. It does support Safari with its experimental mode enabled for example.

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#13

How is this different than web-llm?

web-llm provides optimized kernels for neural network operations, and a convenient API for it. This project provides a place to experiment with CUDA, for any purpose—not necessarily for anything related to machine learning.

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#14
post #4

Firefox supports WebGPU, but needs a setting in about:config. I enabled the setting but HipScript still denies running on Firefox with the message: "Please try a Chromium-based browser like Google Chrome or Microsoft Edge." Please do feature detection, not browser detection.

I do do feature detection—WebGPU is blocked on Release Firefox regardless of config, you'll need nightly. It does support Safari with its experimental mode enabled for example.

I enabled WebGPU in safari on my m1 Mac and got this error when running the GoL demo:

``` TypeError: B.values().some is not a function. (In 'B.values().some(r=>r.args.length)', 'B.values().some' is undefined) ```

EDIT: I got the same error with all three sample scripts

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#16
I love the idea of this, but sadly I can't get it to work in Firefox, Chrome or Edge on my work pc, probably because I can't find "--enable-features=Vulkan" equivalent in the about:flags and the argument doesn't appear to work on windows. I'm actually a bit more curious about a standalone application that skips the webgpu part and goes straight to Vulkan as I would love to be able to experiment with some Cuda only applications.

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#17
post #6

The GoL example it loaded with seemed to be running way slower than I expected it to. It turns out that there's actually a `usleep(1000 * 100)` call in the code which was inserted to make it easier to see the output; the actual kernels execute quickly and take up very little GPU time. When I looked at the profiler, I was confused to see that one worker thread was at 100% usage the whole time it was running. At first,…

Thank you so much for this! I was a bit concerned that the performance on my Mac was nearly identical to my new 3090 on PC and thought I might have messed up the setup there!

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#18
post #16

I love the idea of this, but sadly I can't get it to work in Firefox, Chrome or Edge on my work pc, probably because I can't find "--enable-features=Vulkan" equivalent in the about:flags and the argument doesn't appear to work on windows. I'm actually a bit more curious about a standalone application that skips the webgpu part and goes straight to Vulkan as I would love to be able to experiment with some Cuda only ap…

I don't currently expose the option to run the compiler if a GPU isn't detected, but on systems that do, it exposes a download option that lets you download the SPIR-V kernel to run with Vulkan.

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#19
This is an awesome use of WASIX [1] and the Wasmer SDK [2]. Quite exciting to see!

I recommend as well reading through the blogpost (repo on [3]): https://lights0123.com/blog/2025/01/07/hip-script/ (many things to improve on the Wasmer side... we have some work to do!)

[1] https://wasix.org/

[2] https://github.com/wasmerio/wasmer-js

[3] https://github.com/lights0123/hipscript/

Re: Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU

#20
post #9

How performant is the CUDA code in browser compared to standalone program? Could we have PyTorch / ML training with CUDA through the browser performing ok?

Distributed large model training with web clients?

With 10Tb/s Internet, then sure!
Post reply on HN