Earlier quoted context omitted.
Yes, but not Transformer-based like these two, rather LSTM-based like ULMFiT
Interesting! Did you have to make any substantive changes to the ULMFiT approach to make it work for this problem? Did you use the fastai implementation, or write something from scratch? (Disclaimer: I'm a co-author on the ULMFiT paper.)
off topic, but i saw in one of your fast.ai videos, you were running an autohotkey script. Made my day !