Live data from Hacker News

Curious about the training data of OpenAI's new GPT-OSS models? I was too

twitter.com

1–10 of 62 posts

Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too

#5
>what you can't see from the map is many of the chains start in English but slowly descend into Neuralese

That's just natural reward hacking when you have no training/constraints for readability. IIRC R1 Zero is like that too, they retrained it with a bit of SFT to keep it readable and called it R1. Hallucinating training examples if you break the format or prompt it with nothing is also pretty standard behavior.

Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too

#7
post #2

I don't know how to get a unwalled version. What's the best way to do that these days? xcancel seems unavailable.

Install libredirect extension (https://github.com/libredirect/browser_extension/) and select a few working instances. Then you can use the programmable shortcut keys to cycle between instances if one ever goes down.

Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too

#9
post #3

Anything but this image (imgbb.com link below) requires a login. I get the same deal with Facebook. I am not Don Quixote and prefer not to march into hell for a heavenly cause, nor any other. https://i.ibb.co/Zz2VgY4C/Gx2-Vd6-DW4-AAogtn.jpg

https://xcancel.com/jxmnop/status/1953899426075816164

Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too

#10
post #3

Anything but this image (imgbb.com link below) requires a login. I get the same deal with Facebook. I am not Don Quixote and prefer not to march into hell for a heavenly cause, nor any other. https://i.ibb.co/Zz2VgY4C/Gx2-Vd6-DW4-AAogtn.jpg

https://xcancel.com/jxmnop/status/1953899426075816164

Thanks! I've seen a lot of stuff come and go, so thanks for the reminder.

For example, Libgen is out of commission, and the substitutes are hell to use.

Summary of what's up and not up:

https://open-slum.org/

Post reply on HN