Code for Scaling Transformer to 1M tokens and beyond with RMT (arxiv.org)
1–5 of 5 posts
Re: Code for Scaling Transformer to 1M tokens and beyond with RMT (arxiv.org)
#2I found this interesting link in paper, so this can be used as ready code for RMT Transformer
https://github.com/booydar/t5-experiments/tree/scaling-repor...
Re: Code for Scaling Transformer to 1M tokens and beyond with RMT (arxiv.org)
#3[deleted]
Re: Code for Scaling Transformer to 1M tokens and beyond with RMT (arxiv.org)
#4Re: Code for Scaling Transformer to 1M tokens and beyond with RMT (arxiv.org)
#5[flagged]