Live data from Hacker News

How to Optimize Scaled Dot Product Attention?

Post reply on HN

Print view View original

1–2 of 2 posts

How to Optimize Scaled Dot Product Attention?

#1

Post by yash-sri19 » Tue, Jan 28, 2025, 9:19 AM UTC

How to Optimize Scaled Dot Product Attention?
yash-sri.xyz

Re: How to Optimize Scaled Dot Product Attention?

#2

Post by yash-sri19 » Tue, Jan 28, 2025, 9:19 AM UTC

In this worklog, I explore how to optimize SDPA across cache, quantization and device specific optimizations.

Post reply on HN