Curious about the training data of OpenAI's new GPT-OSS models? I was too
1–10 of 62 posts
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#2Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#3Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#4I don't know how to get a unwalled version. What's the best way to do that these days? xcancel seems unavailable.
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#5That's just natural reward hacking when you have no training/constraints for readability. IIRC R1 Zero is like that too, they retrained it with a bit of SFT to keep it readable and called it R1. Hallucinating training examples if you break the format or prompt it with nothing is also pretty standard behavior.
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#6Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#7I don't know how to get a unwalled version. What's the best way to do that these days? xcancel seems unavailable.
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#8Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#9Anything but this image (imgbb.com link below) requires a login. I get the same deal with Facebook. I am not Don Quixote and prefer not to march into hell for a heavenly cause, nor any other. https://i.ibb.co/Zz2VgY4C/Gx2-Vd6-DW4-AAogtn.jpg
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#10Anything but this image (imgbb.com link below) requires a login. I get the same deal with Facebook. I am not Don Quixote and prefer not to march into hell for a heavenly cause, nor any other. https://i.ibb.co/Zz2VgY4C/Gx2-Vd6-DW4-AAogtn.jpg
https://xcancel.com/jxmnop/status/1953899426075816164
For example, Libgen is out of commission, and the substitutes are hell to use.
Summary of what's up and not up: