Bert pre-training appears to do well even with shuffled words
arxiv.org