LLMs as Markov Chains
arxiv.org