Viewing profile — gkapur

Currently, the most efficient kernels come from vendor libraries like cuBLAS or hand-optimized libraries like FlashAttention. Compiler-generated kernels (TVM, Hidet, Inductor, etc.…

Currently, the most efficient kernels come from vendor libraries like cuBLAS or hand-optimized libraries like FlashAttention. Compiler-generated kernels (TVM, Hidet, Inductor, etc.…

I was curious whether any of the FA-3/4 optimizations transfer to RTX GPUs. vLLM/SGLang attention falls back to FA-2 on consumer cards (FA-3 and FA-4 are datacenter-only), so I wan…

Peter Fenton invested in the company when it was called Infra.App originally (I think it's still online: https://infra.app/ ). It was an access management product, then it became d…

The story of Reflection AI is supposedly that the company was faffing and failing at winning in the coding agent space, but was introduced to Jenson, who suggested they build an op…

If they have a really seamless fine-tuning experience and maybe can help you extract the data you need to FT (which is one of the big challenges in actually getting fine-tuning dem…

It could be but there are a host of companies going after open weights models: Arcee, Reflection, Llama (TBD on Meta's focus on closed-source versus open-source), etc. That said, t…

I'm writing a short series of tutorials on FlashAttention: from theory to efficient CUDA kernels. Part 1 is the theoretical foundation. It walks through a modern algebraic formalis…

On the limitation side: Do you think this would scale to larger transformer models with more parameters per layer? How would this work with MOE models or sparse models?

Adding to the prior comments as my intuition matched yours, there’s a nice Reddit thread that gives some context into how it can be faster even if you require exact matches: https:…

Congratulations to their team. SQLGlot is a really powerful tool that a lot of companies use so a huge contribution to the OSS community so hopefully it continues to be supported a…

There was also Wing cloud (fka Monada) and there’s Mojo by Modular ( https://www.modular.com/mojo .) Feels like two types of companies raised money: - Companies trying to couple th…

If you are running things locally (I would think especially on the edge, whether on not the LLM is local or in the cloud) this would matter. Or if you are running some sort of agen…

I’m convinced I get more “deals” (temporary discounts) from Uber without Uber One/after canceling it, which offsets the benefits from Uber One. I don’t see those deals on Uber Eats…

Today there are so many other solutions: Stytch, Descope, PropelAuth (For B2B companies), and others. VCs went a bit ham on this category when Auth0 got bought. I sense that the ge…

Basically people are constantly calculating metrics based on existing tables. Think something as simple as a moving average or the sum of two separate columns in a table. Once upon…