A General Theoretical Paradigm to Understand Learning from Human Preferences
arxiv.org