Viewing profile — agunapal

My first thought after reading the blog was, let me share the blog with Claude and ask it how bots can circumvent this. imo AI bots have significantly affected OSS and we need bett…

Yes, one can easily setup agents to bump up the stars, increase pip downloads etc

I think it comes down to "Is the juice worth the squeeze" As someone who worked for a large organization maintaining an OSS project, one issue I faced was how do you show impact? W…

Here is a paper from few years ago where they talk about 7x speed increase, which equates to savings. https://arxiv.org/abs/2101.03961

Do you mean model sharding?

Very competitive price for the speed and intelligence being offered!

Nvidia had the first movers advantage. Nvidia spent so many years perfecting CUDA to work well with PyTorch. Before ROCM, there was only CUDA. There were so many developers buildin…

If you really think about why MoE came into existence, its to save significant cost during training, I don't think there was any concrete evidence of performance gains for comparab…