Torch.randperm isn't random and it can bias your trillion token-training run
twitter.com