"Attention is all you need" paper digested (2018)
1–10 of 34 posts
Re: "Attention is all you need" paper digested (2018)
#2Love Yannic
Re: "Attention is all you need" paper digested (2018)
#3[deleted]
Re: "Attention is all you need" paper digested (2018)
#4Re: "Attention is all you need" paper digested (2018)
#5Google regrets publishing this paper!
Re: "Attention is all you need" paper digested (2018)
#6Google regrets publishing this paper!
It’s probably Nobel worth based on its world impact.
Re: "Attention is all you need" paper digested (2018)
#7Google regrets publishing this paper!
Not sure if sarcasm or not.
Re: "Attention is all you need" paper digested (2018)
#8For a higher level shorter overview, I found this video informative: https://youtu.be/SZorAJ4I-sA?si=pnfzZ17PYQfV4aqq
Re: "Attention is all you need" paper digested (2018)
#9Google regrets publishing this paper!
It’s probably Nobel worth based on its world impact.
World impact is not how Nobels are won. If that was the case Elon Musk, Jeff Bezos, Zuckerberg and others would all have multiple ones.
I honestly do not see this paper as being in the same magnitude of brilliance as a typical Nobel would be. Not to mention that it barely counts as science (actually it probably does not). Don't get me wrong. It is a huge achievement for both the machine learning research field and for humanity as a whole, but putting along the achievements of Nobel physicists and such feels wrong.
Re: "Attention is all you need" paper digested (2018)
#10Google regrets publishing this paper!
Here’s the thing, if google didn’t publish this paper, it would probably just collect dust somewhere at Google.
OpenAi (ClosedAi) saw the potential and demonstrated its impressive and unbelievable capabilities!
If Google never shared the transformer model with the world, we would probably not have what we have today.