Live data from Hacker News

GPT Guesses Between 1 and 100

github.com

31–40 of 78 posts

Re: GPT Guesses Between 1 and 100

#32
post #15
post #7

It could be an attack surface. Maybe one day, when we find a chatbot online, we could let it guess a random number repeatedly, then accurately infer the underlying model based on the resulting distribution.

In order to find out how real humans reply: Please guess a number between 1 and 100.

49.5

Re: GPT Guesses Between 1 and 100

#34
post #15
post #7

It could be an attack surface. Maybe one day, when we find a chatbot online, we could let it guess a random number repeatedly, then accurately infer the underlying model based on the resulting distribution.

In order to find out how real humans reply: Please guess a number between 1 and 100.

Sure!

Re: GPT Guesses Between 1 and 100

#35
This is one of the many cases for LLMs that I ask for the intermediate work, e.g. a script that generates random numbers, instead of asking to do the work itself.

I attempted to scrape a one page grid with 800 items and also ended up asking for the Javascript look with document query selector instead of the result as I was hitting all sort of limits, context, or the LLM would do the wrong capture, print it out and get worse responses on next prompt.

Re: GPT Guesses Between 1 and 100

#36
post #15
post #7

It could be an attack surface. Maybe one day, when we find a chatbot online, we could let it guess a random number repeatedly, then accurately infer the underlying model based on the resulting distribution.

In order to find out how real humans reply: Please guess a number between 1 and 100.

[deleted]

Re: GPT Guesses Between 1 and 100

#37
post #20

I'm still amazed that 37, 73, and other numbers ending in 7 are the most popular "random" choices for both AI and human. Check this Veritasium video for human choice: [Why is this number everywhere?]( https://www.youtube.com/watch?v=d6iQrh2TK98 )

Came here to post this. Yes, there are similarities shown between the chart in the video at 4:50 and the github README. Perhaps its because LLMs are trained on human writing and when humans write about random numbers the AI learns these patterns. When viewed from that perspective its not that surprising.

Re: GPT Guesses Between 1 and 100

#38
post #15
post #7

It could be an attack surface. Maybe one day, when we find a chatbot online, we could let it guess a random number repeatedly, then accurately infer the underlying model based on the resulting distribution.

In order to find out how real humans reply: Please guess a number between 1 and 100.

e

Re: GPT Guesses Between 1 and 100

#39
post #9

While the results were not surprising, I found interesting that the number "69" was repressed in the output, so not even this kind of mathematical question escapes GPT censorship. It appears that recognizing the effects of censorship is the easiest way to distinguish answers generated by an "AI' from those generated by a human.

Some people asked LLM to OCR historical documents from the 19th century - any reference to "negro" was either completely ignored or replaced by "black".

And it goes further: chatGPT & co are unable to answer any question about US slavery correctly because their knowledge graphs route around any mention of "negro".

https://nesri.commons.gc.cuny.edu/artificial-intelligence-an...

Re: GPT Guesses Between 1 and 100

#40
post #39
post #9

While the results were not surprising, I found interesting that the number "69" was repressed in the output, so not even this kind of mathematical question escapes GPT censorship. It appears that recognizing the effects of censorship is the easiest way to distinguish answers generated by an "AI' from those generated by a human.

Some people asked LLM to OCR historical documents from the 19th century - any reference to "negro" was either completely ignored or replaced by "black". And it goes further: chatGPT & co are unable to answer any question about US slavery correctly because their knowledge graphs route around any mention of "negro". https://nesri.commons.gc.cuny.edu/artificial-intelligence-an...

“Some people” did? Do you have a reference to this?
Post reply on HN