Why random rotations are good for RoPE
research.novelai.net