PowerRetention: a drop-in replacement for FlashAttention in LLMs
1–3 of 3 posts
Re: PowerRetention: a drop-in replacement for FlashAttention in LLMs
#2Here’s an article I found from Manifest AI, the company behind Power Retention: https://manifestai.com/articles/what-is-power-retention/
Re: PowerRetention: a drop-in replacement for FlashAttention in LLMs
#3I am one of the authors, happy to answer any questions!