Viewing profile — smhx

If you're the author, unfortunately I have to say that the blog is not well-written -- misinformed about some of the claims and has a repugnant click-baity title. you're getting th…

the author got a couple of things wrong, that are worth pointing out: 1. PyTorch is going all-in on torch.compile -- Dynamo is the frontend, Inductor is the backend -- with a stron…

it's not a new PyTorch feature. It's just a showcase of existing PyTorch features (including libtorch) as an end-to-end example. On the server-side it uses libtorch, and on mobile,…

that's a direct implication that they're waiting for a liquidity event before they speak

most of the GenAI players use both PyTorch and JAX, depending on the hardware they are running on. Character, Anthro, Midjourney, etc. are dual shops (they use both). xAI only uses…

You've created a superior llama/mistral-derivative model -- like https://old.reddit.com/r/LocalLLaMA/comments/17vcr9d/llm_com... How can you convince the world to use it (and pay y…

>What's a fair benchmark? the absolute golden benchmarks are https://github.com/pytorch/benchmark They are a diverse set of userland code taken from github as-is and made into benc…

thanks for the heads-up, looks like we didn't yank the CPU wheels on those dates. will get to them in the next set of working hours, as its an unlikely scenario (not only do you ha…

> So technically, if you are pulling the older version of pytorch-nightly (specifically 2.0.0.dev20221230), it will still pull that compromised dependency (because torch have expli…

This is the last one. It was also the first one.

this only affects the nightly pytorch. the stable pytorch build doesn't depend on `torchtriton`. the nightly pytorch moved to depend on our own secured `pytorch-triton` now, secure…

the version numbers are different, even though the package names are the same. A stable version will have a version number such as `1.13.0`, where as a nightly version will have th…

ShardedTensor was merged / subsumed into DTensor: https://dev-discuss.pytorch.org/t/rfc-pytorch-distributedten... Lots of development and traffic happening here: https://github.com…

It can run much faster. For example, using the PyTorch nvFuser JIT gives a 50% speedup: https://old.reddit.com/r/MachineLearning/comments/xa75km/p_p...

counter-example: CPython, NumPy, SciPy and many critical well-used open-source projects that have tiny volunteer teams and operational budgets that are minuscule compared to someth…

Whether using Lua or Python, for GPU-based scientific computing, the need to drop into a C call is the same. The overhead of Python vs Lua never really mattered. While we were base…

We ship everything needed for userland -- including parts of CUDA/CuBLAS and CuDNN that we need (which is why our binaries are so fat). GPU drivers would be kernel-land and I don't…

Author here. Being conscious about speed and performance is different from making that your competitive advantage or USP. Our main focus is usability, and one of our secondary focu…

another good resource that's more specific to machine learning is https://paperswithcode.com/datasets

I've been helping on the project, it's lead by Chris Cummins and Hugh Leather. Just a heads-up for folks, we haven't fully cleaned up and gotten ready for public attention yet, we …