Viewing profile — zanussbaum

First embedding models trained from modern-bert-embed!

this was a huge inspiration for the post! i tried to highlight it in the blog but it might have gotten buried there are a few things that i wasn't able to figure out how to get acc…

oh in that case it was because i didn't know about them :) something to try next!

at least on my m2, the compiled kernel ends up using fast math anyways so using WGSL's fma didn't change anything about the actual kernel that gets run

thanks! and yes definitely not at CUDA levels :)

i tried using workgroup shared memory and found it slower than just recomputing everything in each thread although i may have been doing something dumb i'm excited to try subgroups…

you're definitely right, 80% was a bit of an overestimation, especially with respect to CUDA it would be cool to see if there's some way to get better access to those lower-level p…

great question, to me webGPU sits a hair high level than CUDA or Vulkan. so you don't have the exact same level of control but can get to 80% performance of it without having to wr…

Has been a huge boost over using Copilot. I accidentally was using Copilot instead of Codeium and was confused why the generations took so long until I realized! Great product

This made my day