I was reading the paper, and then it hit me ... Did they use ChatGPT to generate their abstract? Almost certainly not, but I wonder how well it does at that? Come up with a (fake) way to improve the transformer architecture, then write the title and abstract. Title: Novel Cyclical Attention Mechanism Enhances Transformer Architectures Abstract: The transformer architecture has emerged as a powerful model for handling…
Re: Ring attention with blockwise transformers for near-infinite context
#21It means that ChatGPT has seen too many papers.
Honestly, when I was a PhD student back then, every time I review papers, I felt like are these papers written by me because I would write them that way LoL