Viewing profile — jeremycochoy

Well, RWKV is using some linear (non-quadratic) form of attention so... strictly speaking... you still need a bit of attention :D

I believe RWKV is actually an architecture that can be used for encoding: given a LSTM/GRU, you can simply take the last state as an encoding of your sequence. The same should be p…

Although after doing some research I figured out what you are referencing for Hungary with some googling, some references would have been appreciated. Do you have some references a…

Hello HN community. I am developing a web service which remove text from natural images, and a friend recommended me to share it with you. A nice test is for example the doge meme …