Viewing profile — gauravm

New blog post on Efficient AI Techniques: KV Caching and KV Sharing. Efficient training and inference is table stakes for LLMs these days, and these two algorithmic efficiency tech…

We have been working on a book that focuses on deep learning efficiency techniques such as quantization, pruning, distillation, etc. for both server-side as well as on-device (smar…

There is Tensorflow Lite that Google just opensourced.

Sadly, there is no 'R' anymore :-/

I really like this approach of gamified interview prep, kind of like Duoling style learning. Practicing for interviews is hard, and this makes it a little more fun :) Good luck!

I wanted something easy to use to quickly get an idea of how much explicit content could we be dealing with. The main challenge was dealing with a multi-lingual database. I didn't …

Thanks. This quick idea worked for my cases, because there were few potential false positives. But your idea around using a regex style matcher should be good.

Sorry, no offense intended, if anyone took it. In my use-case, the words such as 'gay' and 'lesbian' were in almost all cases, used for explicit documents. This is a very naive imp…

Is it just me or does the abstract seems like it was written by some grammar retard?

I have implemented Bloom Filters which are Scalable in Go. This is similar to the bit.ly dablooms project. But, my construction is in Go, and simpler.