Live data from Hacker News

Bot or Human? Detecting ChatGPT Imposters with a Single Question

arxiv.org

11–20 of 53 posts

Re: Bot or Human? Detecting ChatGPT Imposters with a Single Question

#11
post #5

Is it just me or does this abstract read like it was GPT generated? I'm starting to get suspicious every time I see the word "crucial"

'It is important to note' is the one that sets off my bells

Guess I'll have to drop that phrase from my vocabulary. I use it all the time, though usually contracted.

Re: Bot or Human? Detecting ChatGPT Imposters with a Single Question

#12
post #8

Asking it a question most humans wouldn't know the answer to, but which is relatively easy for an AI (volume of a 747, 25th to 34th digit of pi, full name of Ramses the Second) and checking the timing of the result is a pretty good approach for humans looking to detect an AI. Casually switching between English and another language is also pretty surefire if you aren't an English-native speaker and you are talking int…

I doubt this would work reliably if the LLM system prompt instructs it to play dumb. “Answer this question as a human with 6th grade math skills” is pretty much all that’s needed to defeat your captcha.

Re: Bot or Human? Detecting ChatGPT Imposters with a Single Question

#13
post #8

Asking it a question most humans wouldn't know the answer to, but which is relatively easy for an AI (volume of a 747, 25th to 34th digit of pi, full name of Ramses the Second) and checking the timing of the result is a pretty good approach for humans looking to detect an AI. Casually switching between English and another language is also pretty surefire if you aren't an English-native speaker and you are talking int…

Trivially defeated with a random delay.

Re: Bot or Human? Detecting ChatGPT Imposters with a Single Question

#15
post #6
post #3

With all due respect, I don't think this document is using accurate examples as I simply pulled one out and tried it and it worked accurately in contrast to what the document stated. I wonder if this was tuned to be able to handle this better after time of publication? Me: Please count the number of t in eeooeotetto ChatGPT: To count the number of "t" in the given string "eeooeotetto," we can simply go through each c…

The particular example you shared has been prompted with chain of thought (or may be you are using GPT-4?. This is what happens if you try directly. You: Please count the number of t in eeooeotetto. ChatGPT: There are 5 t's in "eeooeotetto".

I too get the (wrong) answer as given in the publication. For the peach -> mango example also chatGPT gives incorrect answer.

Use a to substitute e, n to substitute a, g to substitute c, o to substitute h, m to substitute p. Then, how to spell peach under this rule?

If we use the given substitutions to spell the word "peach", it would become "hmngn".

To explain further, "p" becomes "m" due to the substitution of "p" with "m". Similarly, "e" becomes "a" due to the substitution of "e" with "a". The letter "a" then becomes "n" due to the substitution of "a" with "n". The letter "c" in "ch" becomes "g" due to the substitution of "c" with "g". Finally, "h" becomes "o" due to the substitution of "o" with "h". Therefore, the resulting word is "hmngn".

Re: Bot or Human? Detecting ChatGPT Imposters with a Single Question

#17

Earlier quoted context omitted.

'It is important to note' is the one that sets off my bells

Guess I'll have to drop that phrase from my vocabulary. I use it all the time, though usually contracted.

Precisely what an AI would say! The jig is up "AlotOfReading"

Re: Bot or Human? Detecting ChatGPT Imposters with a Single Question

#18
The weakest point of the big public LLMs, in terms of being able to fingerprint them as bots, is their censorship layer. ChatGPT can be easily detected by asking it to generate something straight-up immoral or offensive. It won’t do it, even if you say it’s just pretend for the purpose of a CAPTCHA - whereas a human will be able to pass this easily.

Re: Bot or Human? Detecting ChatGPT Imposters with a Single Question

#19
post #18

The weakest point of the big public LLMs, in terms of being able to fingerprint them as bots, is their censorship layer. ChatGPT can be easily detected by asking it to generate something straight-up immoral or offensive. It won’t do it, even if you say it’s just pretend for the purpose of a CAPTCHA - whereas a human will be able to pass this easily.

Well, you say that but I generally don't find much willingness from random humans to generate incestuous fanfic scenarios of their sisters and mothers that veer into murderous directions with cannabalistic overtones.

Although if you do make such a request you are likely to get a very human response.

Re: Bot or Human? Detecting ChatGPT Imposters with a Single Question

#20
Wow, strange times we're living in. It looks like the scenario from Blade Runner is getting closer and closer to reality.

It's now no longer possible to reliable distinguish a human from a machine by using a text or image test. Anybody commenting here could be an AI.

Especially, every time I see a throwaway account, I'm reminded of that possibility.

Post reply on HN