[dead]
Curious about the training data of OpenAI's new GPT-OSS models? I was too
11–20 of 62 posts
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#125 seems to do a better job with copyrighted content. I got it to spit out the entirely of ep IV (but you have to redact the character names)
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#13> OpenAI has figured out RL. the models no longer speak english
What does this mean?
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#14> OpenAI has figured out RL. the models no longer speak english What does this mean?
Interesting. This happens in Colossus: The Forbin Project (1970), where the rogue AI escapes the semantic drudgery of English and invents its own compressed language with which to talk to its Russian counterpart.
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#15[deleted]
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#16> OpenAI has figured out RL. the models no longer speak english What does this mean?
The model learns to reason on its own. If you only reward correct results but not readable reasoning, it will find its own way to reason that is not necessarily readable by a human. The chain may look like English, but the meaning of those words might be completely different (or even the opposite) for the model. Or it might look like a mix of languages, or just some gibberish - for you, but not for the model. Many models write one thing in the reasoning chain and a completely different in the reply.
That's the nature of reinforcement learning and any evolutionary processes. That's why the chain of thought in reasoning models is much less useful for debugging than it seems, even if the chain was guided by the reward model or finetuning.
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#17> the chains start in English but slowly descend into Neuralese
What is Nueralese? I tried searching for a definition but it just turns up a bunch of Less Wrong and Medium articles that don't explain anything.
Is it a technical term?
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#18> the chains start in English but slowly descend into Neuralese What is Nueralese? I tried searching for a definition but it just turns up a bunch of Less Wrong and Medium articles that don't explain anything. Is it a technical term?
I suppose it means LLM gibberish
EDIT: orbital decay explained it pretty well in this thread
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#19This looks very interesting but I don't really understand what he has done here. Can someone explain the process he has gone through in this analysis?
Re: Curious about the training data of OpenAI's new GPT-OSS models? I was too
#20> the chains start in English but slowly descend into Neuralese What is Nueralese? I tried searching for a definition but it just turns up a bunch of Less Wrong and Medium articles that don't explain anything. Is it a technical term?
neuralese is a term first used in neuroscience to describe the internal coding or communication system within neural systems.
it originally referred to the idea that neural signals might form an intrinsic "language" representing aspects of the world, though these signals gain meaning only through interpretation in context.
in artificial intelligence, the term now has a more concrete role, referring to the deep communication protocols used by multiagent systems.