Why Are Sines and Cosines Used for Positional Encoding?
mfaizan.github.io