Live data from Hacker News

Ring attention with blockwise transformers for near-infinite context

arxiv.org

21–23 of 23 posts

Re: Ring attention with blockwise transformers for near-infinite context

#21
post #15

I was reading the paper, and then it hit me ... Did they use ChatGPT to generate their abstract? Almost certainly not, but I wonder how well it does at that? Come up with a (fake) way to improve the transformer architecture, then write the title and abstract. Title: Novel Cyclical Attention Mechanism Enhances Transformer Architectures Abstract: The transformer architecture has emerged as a powerful model for handling…

It means that ChatGPT has seen too many papers. Honestly, when I was a PhD student back then, every time I review papers, I felt like are these papers written by me because I would write them that way LoL
Post reply on HN