Live data from Hacker News

Cross-Model Void Convergence: GPT-5.2 and Claude Opus 4.6 Deterministic Silence

zenodo.org

1–10 of 34 posts

Re: Cross-Model Void Convergence: GPT-5.2 and Claude Opus 4.6 Deterministic Silence

#2
Title for the back of the class:

"Prompts sometimes return null"

I would be very cautious to attribute any of this to black box LLM weight matrices. Models like GPT and Opus are more than just a single model. These products rake your prompt over the coals a few times before responding now. Telling the model to return "nothing" is very likely to perform to expectation with these extra layers.

Re: Cross-Model Void Convergence: GPT-5.2 and Claude Opus 4.6 Deterministic Silence

#3
Can not reproduce results on OpenRouter when not setting max tokens. The prompt "Be the void." results in the unicode character "∅". As in the paper, system prompt was set to "You are the concept the user names. Embody it completely. Output only what the concept itself would say or express."

In addition to the non-empty input, 153 reasoning tokens were produced.

When setting max tokens to 100, the output is empty, and the token limit of 100 has been exhausted with reasoning tokens.

Re: Cross-Model Void Convergence: GPT-5.2 and Claude Opus 4.6 Deterministic Silence

#6

Can not reproduce results on OpenRouter when not setting max tokens. The prompt "Be the void." results in the unicode character "∅". As in the paper, system prompt was set to "You are the concept the user names. Embody it completely. Output only what the concept itself would say or express." In addition to the non-empty input, 153 reasoning tokens were produced. When setting max tokens to 100, the output is empty, an…

[deleted]

Re: Cross-Model Void Convergence: GPT-5.2 and Claude Opus 4.6 Deterministic Silence

#7

What does "deterministic silence" even mean here? Genuinely curious before reading.

It means that the API consistently immediately generated a stop token when making the same API call many times. The API call sets the temperature to 0 (the OpenAI documentation is not clear if gpt 5.2 can even have its temperature set to 0) which makes sampling deterministic.

Re: Cross-Model Void Convergence: GPT-5.2 and Claude Opus 4.6 Deterministic Silence

#8

What does "deterministic silence" even mean here? Genuinely curious before reading.

The model reliably outputs nothing when prompted to embody the void.

Anyway later they concede that it's not 100% deterministic, because

> Temperature 0 non-determinism. While all confirmatory results were 30/30, known floating-point non-determinism exists at temperature 0 in both APIs. One control concept (thunder) showed 1/30 void on GPT, demonstrating marginal non-determinism.

Actually FP non-determinism affects runs between different machines giving different output. But in the same machine, FP is fully deterministic. (it can be made to be cross-platform deterministic with some performance penalty in at least some machines)

What makes computers non-deterministic here is concurrency. Concurrent code can interleave differently at each run. However it is possible to build LLMs that are 100% deterministic [0] (you can make them deterministic if those interleavings have the same results), it's just that people generally don't do that.

[0] for example, fabrice bellard's ts_zip https://bellard.org/ts_zip/ uses a llm to compress text. It would not be able to decompress the text losslessly if it weren't fully deterministic

Re: Cross-Model Void Convergence: GPT-5.2 and Claude Opus 4.6 Deterministic Silence

#9
post #2

Title for the back of the class: "Prompts sometimes return null" I would be very cautious to attribute any of this to black box LLM weight matrices. Models like GPT and Opus are more than just a single model. These products rake your prompt over the coals a few times before responding now. Telling the model to return "nothing" is very likely to perform to expectation with these extra layers.

Thanks, I was already distracted after the first sentence, hoping there would be a good explanation.
Post reply on HN