Arrows of Time for Large Language Models
1–5 of 5 posts
Re: Arrows of Time for Large Language Models
#2Isn't it obvious that since LLM are trained to predict the next word they do better than to predict the previous one?
Re: Arrows of Time for Large Language Models
#3Isn't it obvious that since LLM are trained to predict the next word they do better than to predict the previous one?
[deleted]
Re: Arrows of Time for Large Language Models
#4Isn't it obvious that since LLM are trained to predict the next word they do better than to predict the previous one?
In the paper it is mentioned that the LLMs predicting the previous token are indeed pre-trained in this way, so it is not true that the difference is obvious.
Re: Arrows of Time for Large Language Models
#5There is a link with entropy creation?