Just feed them bogus info and corrupt their models. That will make them stop.
Anyone got a contact at OpenAI. They have a spider problem
231–240 of 400 posts
Re: Anyone got a contact at OpenAI. They have a spider problem
#232Earlier quoted context omitted.
Reminds me of a joke Three logicians walk into a bar. The bartender says "what'll it be, three beers?" The first logician says "I don't know". The second logician says "I don't know". The third logician says "Yes".
And the human bartender passes the check to the third logician.
The third logician never finishes his beer, his friends get more free beers. The bar overflows.
Re: Anyone got a contact at OpenAI. They have a spider problem
#233This reminds me of how GPT-2/3/J came across https://reddit.com/r/counting , wherein redditors repeatedly post incremental numbers to count to infinity. It considered their usernames, like SolidGoldMagikarp, such common strings on the Internet that, during tokenization, it treated them as top-level tokens of their own. https://www.alignmentforum.org/posts/8viQEp8KBg2QSW4Yc/solid... https://www.lesswrong.com/posts/LAx…
I wonder how much the source content is the cause of hallucinations rather than anything inherent to LLMs. I mean if someone posts a question on an internet forum that I don't know the answer to, I'm certainly not going to post "I don't know" since that wouldn't be useful. In fact, in general, in any non one-on-one conversation the answer "I don't know" is not useful because if you don't know in a group, your silence…
I'm really cross that the word "hallucination" has taken off to describe this as it's clearly in incorrect word. The correct word to describe it is "confabulation", which is clinically more accurate and a much clearer descriptor of what's actually going on.
Re: Anyone got a contact at OpenAI. They have a spider problem
#234Earlier quoted context omitted.
Nowadays they are instead learning to say "please join our Discord for support"!
Much like one of the first phrases spoken by babies today is "like and subscribe".
Isn't there some kind of voice or video generation model that says "be sure to like and subscribe" given an empty prompt?
Re: Anyone got a contact at OpenAI. They have a spider problem
#235Earlier quoted context omitted.
Much like one of the first phrases spoken by babies today is "like and subscribe".
Part of me really wants to believe this is a joke. But given how often toddlers are "taken care of" by planting them in front of youtube :|
Which is crazy because there's plenty of good content for kids on Youtube (if you really need a break!). Blippy, Meekah, Seasame Street, even that mind-numbing drivel Cocomelon (which at least got my girls talking/singing really early).
Re: Anyone got a contact at OpenAI. They have a spider problem
#236Earlier quoted context omitted.
I wonder how much the source content is the cause of hallucinations rather than anything inherent to LLMs. I mean if someone posts a question on an internet forum that I don't know the answer to, I'm certainly not going to post "I don't know" since that wouldn't be useful. In fact, in general, in any non one-on-one conversation the answer "I don't know" is not useful because if you don't know in a group, your silence…
Reminds me of a joke Three logicians walk into a bar. The bartender says "what'll it be, three beers?" The first logician says "I don't know". The second logician says "I don't know". The third logician says "Yes".
[deleted]
Re: Anyone got a contact at OpenAI. They have a spider problem
#237Dude, you have caught the spider. Now use it. Start inserting whatever random junk you can until "astronaut riding a horse" looks more like Ronald MacDonald driving a Ferrari.
I feel like inserting "free user-tagged vacation images" into my robots.txt then pointing the spider at an endless series of fabric swatches.
Re: Anyone got a contact at OpenAI. They have a spider problem
#238This reminds me of how GPT-2/3/J came across https://reddit.com/r/counting , wherein redditors repeatedly post incremental numbers to count to infinity. It considered their usernames, like SolidGoldMagikarp, such common strings on the Internet that, during tokenization, it treated them as top-level tokens of their own. https://www.alignmentforum.org/posts/8viQEp8KBg2QSW4Yc/solid... https://www.lesswrong.com/posts/LAx…
> GPT-3 reportedly had only 50,257
The most common vocabulary size today is 32k.
Re: Anyone got a contact at OpenAI. They have a spider problem
#239Earlier quoted context omitted.
I wonder how much the source content is the cause of hallucinations rather than anything inherent to LLMs. I mean if someone posts a question on an internet forum that I don't know the answer to, I'm certainly not going to post "I don't know" since that wouldn't be useful. In fact, in general, in any non one-on-one conversation the answer "I don't know" is not useful because if you don't know in a group, your silence…
Contrast with Q&A on products on Amazon where people routinely answer that way. I have flagged responses saying "I don't know" but nothing ever comes of it.
This is Amazon's fault; they send an email that looks like it's specifically directed to you. "ceejayoz, a fellow customer has a question on..."
At some point fairly recently they added a "I don't know the answer" button to the email, but it's much less prominent than the main call-to-action.