Viewing profile — yu3zhou4

I’m happy it helps you!

If you prefer C++ and CUDA, then there's also tiny-vllm of mine [0] - recently we broke 1k gh stars [0] https://github.com/jmaczan/tiny-vllm

My fav zine

It's a very useful guide, I used it when working on torch-webgpu some time ago. Elie also published few packages that help with using some WebGPU related things, I don't remember e…

Print ondemand can be ordered for less than $5 per zine in Lulu, since 2022 or so. I guess Zach doesn’t make a cut from it since this $5 probably barely covers the cost of print an…

PyTorch?

README is in my opinion (author here) the most interesting - I wrote it to help others build useful mental model to be able to recreate the project yourself, without need to even r…

There was onivim that was a bit hyped a few years ago but unfortunately it died

Just learning math and trying myself in ml research

Laughed hard about Collegium Tumanum

Poland was sort of occupied until 1989

Good idea, too! Why do you see my explanation as cynical, though?

Maybe it’s in order to have an external provider to blame for failures and shift the blame/responsibility?

Adding a support for new hardware to PyTorch is actually quite convenient. I did that with WebGPU using the same PrivateUse1 mechanism TorchTPU used. Every hardware has its own slo…

They write that they use PrivateUse1, so it’s a custom out-of-tree backend

The system like iOS is still closed. Once Apple ends support for a device, being able to swap a battery won’t help much

For a last few days, I keep hitting chat limits on Sonnet 4.6 and I perceive it to be like 5-10x faster to hit the limit than it used to a week ago. What happened? Do you also expe…

Thx, great read about Yemen from Maciej Cegłowski https://idlewords.com/2014/07/sana_a.htm