Live data from Hacker News

Ask ChatGPT to pick a number from 1-10000, it generally selects from 7200-7500

old.reddit.com

31–40 of 68 posts

Re: Ask ChatGPT to pick a number from 1-10000, it generally selects from 7200-7500

#31

It's the same "brain", starting from exactly the same prompt, the same context, which means the same thoughts, the same identity... How do you expect it to produce different values?

In a pure LLM I agree. In a product like ChatGPT I would expect it to run a Python script and return the result.

Re: Ask ChatGPT to pick a number from 1-10000, it generally selects from 7200-7500

#34
post #5

https://chatgpt.com/share/69be3eeb-4f78-8002-b1a1-c7a0462cd2... First - 7421 Second attempt - 1836

I bet that for the second random number in the same session, it is significantly less likely for an LLM to repeat its first number compared to two random draws. LLMs seem to mimic the human tendency to consider 7 as the most random, and I feel like repeating a random number would be perceived as not random.

Re: Ask ChatGPT to pick a number from 1-10000, it generally selects from 7200-7500

#35
post #21

when you make a program that has a random seed, many LLMs choose 42 as the seed value rather than zero. A nice nod to Hitchhikers’

Probably because that’s what programmers do, present in the LLM training data? I certainly remember setting a 42 seed in some of my projects

Re: Ask ChatGPT to pick a number from 1-10000, it generally selects from 7200-7500

#37
This is what I hate about people trusting it. If you rely on AI to operate in a domain you don't man-handle, you will be tricked, and hackers will take advantage.

"AI! Write me gambling software with true randomness, but a 20% return on average over 1000 games"

Who will this hurt? The players, the hackers or the company.

When you write gambling software, you must know the house wins, and it is unhackable.

Re: Ask ChatGPT to pick a number from 1-10000, it generally selects from 7200-7500

#38
post #19

Earlier quoted context omitted.

By emitting a next token distribution with a 10% chance of 0, 10% chance of 1, etc. Also it's an LLM, not a brain.

Interesting. So you expect it to "not think" and simply produce a value corresponding to "it's the same to me", knowing that it will be translated into an actual random value. Instead, exactly as a person would do, it does think of a specific number that feels random in that particular moment.

If I care a little bit about that random number I might reach for my phone and look at the digits of the seconds of the current time. It's 31 now. Not appropriate for multiple lookups.

Re: Ask ChatGPT to pick a number from 1-10000, it generally selects from 7200-7500

#39

It's the same "brain", starting from exactly the same prompt, the same context, which means the same thoughts, the same identity... How do you expect it to produce different values?

LLMs aren't deterministic - they calculate a probability distribution of the potential next token and use sampling to pick the output.

Re: Ask ChatGPT to pick a number from 1-10000, it generally selects from 7200-7500

#40

The prompt doesn't say to pick a random number. I asked to pick a number from 1-1000 and it chose 7,381. Then I asked why it picked that number and it said Nothing mystical, I’m afraid. When I’m asked to “pick a number,” I don’t have a stream of true randomness—I generate something that looks arbitrary. In this case, I leaned toward: • something comfortably away from the edges (not near 1 or 10,000), • not a round or…

Not sure why you have been downvoted. While the LLM's introspection can't be trusted, that's indeed what happens: asked to generate a random number, the LLM picks one that feels random enough: not a round one, not too central or extreme, no patterns, not a known one. It ends up being always the same.
Post reply on HN