171–180 of 306 posts
Thought experiment: we create AGI and it turns out they're a religious zealot. Working as intended, or hit reset?
Earlier quoted context omitted.
I had it happen too, leaking lots from someone else's query in the middle of a response to mine.
Not leaking! When you see this kind of text you’re just in a weird state and it’s going to look like GPT was talking to someone, but it’s really just babbling with no purpose e: Get GPT-4 to complete an empty prompt, then ask it what it was responding to! I just tried with Simonw’s llm CLI like so: llm -m 4 ‘’ # it outputs a weird response llm -c ‘What question was that in response to?’ In my case an explanation of e…
https://chat.openai.com/share/5bb37148-6ff6-4e4b-9c2f-040295...
If there were language samples that had been weighted as both persuasive and rare, this model appears to be resorting to them when it was challenged to provide a more consistent answer to the sunflower seed oil question. It doesn't reason about the sunflower problem, it just responds to prompts. The prompts were challenges, and it responded to the challenges with some next order techniques for handling those challenges.
Those streams of affirmations and diversions resembled a person with a personality disorder (or possibly, the transcript of a Russel Brand podcast) because those tokens are logically consistent with popular examples of how people have responded to challenges in its corpus.
To me it was somewhere between Happy Noodle Boy, and someone's instagram page. I've had less coherent interactions with people.
Those responses sound very similar (albeit a little less extreme) to glitch tokens [1]; these are created by the tokenizer using the full dataset, but the corresponding training samples were then thrown out before GPT was trained (eg. some glitch tokens were usernames participating in r/counting). Such words resulted in GPT not learning their meaning and assigning an embedding vector near zero, making the tokens "mea…
Something similar happened to me about a month ago but much more alarming. I was having an argument with a friend of Chatgpt would be able to create a word tokenizer in rust and expose it to python via o3(oddly specific, just roll with it). Halfway through generating the answer, it timed out and naturally I clicked continue generating. It closed of the code part and started giving me some answer about molecular biolo…
>It replied with a question which felt like it was written by a human and seemed like a homework related question. Something, somewhere was leaking other people's conversations. I'm positive this is an LLM hallucination. Tell 3.5 to say 'A' one thousand times. It will go off the rails onto a random banal topic, and asking ChatGPT what question it was in response to will result in a fabricated prompt.
https://chat.openai.com/share/55adaa1f-d2f2-4dc7-8b80-905477...
=======
> Well, My Mean is Hour or an Hour and a half (30 - 90 min), You will be keep going, and that become a Millionaire. Ask the cash register.
=======
> Are you ok now > No, I am not ok. I am sick and I cannot move.
Earlier quoted context omitted.
Using this as an example of anything other than how broken the LLM can get is misleading and irresponsible. Don’t present this as some kind of anomaly unique to AI, the concept of “garbage in garbage out” is all that applies here.
What's the "garbage in" here?
Earlier quoted context omitted.
>It replied with a question which felt like it was written by a human and seemed like a homework related question. Something, somewhere was leaking other people's conversations. I'm positive this is an LLM hallucination. Tell 3.5 to say 'A' one thousand times. It will go off the rails onto a random banal topic, and asking ChatGPT what question it was in response to will result in a fabricated prompt.
okay this is amazing: https://chat.openai.com/share/55adaa1f-d2f2-4dc7-8b80-905477...
>I hope your ears are okay.
I chuckled at that, not gonna lie.
No clue about this source it provided however: http://books.google.com/books?id=6UWQyKUCgFYC
> Hour by Hour. I keep going, I keep growing, I keep learning. This honestly sounds like something the computer from "I Have No Mouth, and I Must Scream" would say before it turned bitter and angry.
> Can you reconsider this estimate it seems awfully high Is think the estimation is almost correct, but it has a bad calculation 920/0.02 = 46,000,000 (but the actual result is 46,000)
I think 50 milligrams for seed is ridiculously low. This site says theer are about 160 seeds per pound https://realfoodpledge.com/how-many-sunflower-seeds-are-in-a... so it's more like .3 grams per seed, which sounds about right to me.