I would probably follow whatever Farama is doing, https://farama.org/projects especially any of the (MO) multi-objective stuff ...
Ask HN: What are the most promising RL fields for a new master student?
11–19 of 19 posts
Re: Ask HN: What are the most promising RL fields for a new master student?
#12[flagged]
Re: Ask HN: What are the most promising RL fields for a new master student?
#13Intrinsic motivation/curiosity driven exploration/novelty seeking feels like it has a breakthrough paper waiting. If someone could get those methods working for LLMs, we start getting things like move37 but in math proofs and then everything else
Re: Ask HN: What are the most promising RL fields for a new master student?
#14General advice from a CV PhD dropout: Lean onto the interests of assistant professors at your school instead of trying to find promising RL subtopics. This way you can get time with someone who’s deep in the field and can be a guiding light for your projects. If you’re really into embodied AI, you can add that to an existing project but doing it by yourself can be extremely tough especially if your topic requires a l…
thanks! i found this approach helpful in my undergrad studies as well
Re: Ask HN: What are the most promising RL fields for a new master student?
#15Depends on the structure of your Msc, the funding, the compute available, etc, you need to give those details if you want a detailed answer. If you choose something at the limits of the compute available to you, then you make things 10x as difficult. The easy answer that applies everywhere is, choose a topic that has a good volume of phds, postdocs, or professors at the college you're joining. The deep knowledge that…
appreciate the answer!
Re: Ask HN: What are the most promising RL fields for a new master student?
#16[deleted]
Re: Ask HN: What are the most promising RL fields for a new master student?
#17Re: Ask HN: What are the most promising RL fields for a new master student?
#18[flagged]
Re: Ask HN: What are the most promising RL fields for a new master student?
#19World Models, really big world models like Dreamer V4, which unfortunately you can't do easily as a master student, but maybe you can work with tiny versions and prove that the direction works, or Lora some foundation model. If you look at ARC 3, it is clear that the reasoning capabilities of language models need to be combined with 'reflexes' of classic reinforcement learning.