Viewing profile — shreyansh26

[dead]

What’s covered: 1. Hierarchical scans: block-local scan → write block totals → scan totals → carry-in add 2. Single-pass scans: the "domino" idea, and why naive inter-block propaga…

A short deep-dive on Multi-Head Latent Attention (MLA) (from DeepSeek): intuition + math, then a walk from MHA → GQA → MQA → MLA, with PyTorch code and the fusion/absorption optimi…

A simplified implementation of FlashAttention in PyTorch for educational purpose.

Haha, so all one has to do is to add some fancy terms like LLMs, vectors, hyper-fast and 300+ Github stars. What a a joke lol!

OpenAI is actually the one which has made AI so open and accessible for all. Perhaps not open source but all the developers building cool AI products these days are mostly due to O…

That's helpful. Thanks!

I am looking for good technical resources to study recommender systems in depth. Anything from books, courses to blogs would be helpful. Would also be better if I could follow alon…