Unpacking the HF in RLHF
maestroai.substack.com
Unpacking the HF in RLHF
1–4 of 4 posts
Re: Unpacking the HF in RLHF
#2Some observations on a few ways different people actually gather feedback from humans in practice to improve LLMs. Sure I've missed some here, so let me know.
Re: Unpacking the HF in RLHF
#3Some observations on a few ways different people actually gather feedback from humans in practice to improve LLMs. Sure I've missed some here, so let me know.
I think tying the feedback to a task is the way to go. I don't know exactly what they do with it but my son is a fan of Craiyon and Craiyon shows you a few images it generated and encourages you to favorite the best ones. I'm sure you could RLHF an image generator too.
See my comment on this thread
https://news.ycombinator.com/item?id=35069965
I'd be glad to chat more (see my profile) but I think as much as people think there is a scalability advantage to a big co training one big model the problems of pleasing everybody, particularly advertisers, are terrible but a personal model that pleases one person might be easy with recent tech.
Re: Unpacking the HF in RLHF
#4Some observations on a few ways different people actually gather feedback from humans in practice to improve LLMs. Sure I've missed some here, so let me know.
I think tying the feedback to a task is the way to go. I don't know exactly what they do with it but my son is a fan of Craiyon and Craiyon shows you a few images it generated and encourages you to favorite the best ones. I'm sure you could RLHF an image generator too. See my comment on this thread https://news.ycombinator.com/item?id=35069965 I'd be glad to chat more (see my profile) but I think as much as people th…
Hey, thanks for the reply. Would love to chat more.