Live data from Hacker News

Gemini AI tells the user to die

tomshardware.com

111–120 of 150 posts

Re: Gemini AI tells the user to die

#111

1. Get huge amounts of raw, unfiltered, unmoderated data to feed model 2. Apologize, claim there's no way they could have possibly obtained better, moderated, or filtered data despite having all the money in the world. 3. Profit... while telling people to kill themselves... I get that a small team, universities, etc. might not be able to obtain moderated data sets.. but companies making billions on top of billions sh…

[deleted]

Re: Gemini AI tells the user to die

#112

1. Get huge amounts of raw, unfiltered, unmoderated data to feed model 2. Apologize, claim there's no way they could have possibly obtained better, moderated, or filtered data despite having all the money in the world. 3. Profit... while telling people to kill themselves... I get that a small team, universities, etc. might not be able to obtain moderated data sets.. but companies making billions on top of billions sh…

Makes sense that trolls always refer to other people as humans. That freaking explains it. The model was trained on this.

Seriously. There’s no explanation for this.

You humans think you can explain everything with random details as if you know what’s going on. You don’t.

Re: Gemini AI tells the user to die

#113
Before universities start using AI as part of their teaching, they should probably think about this kind of thing. I've heard so much recently about "embracing" and "embedding" AI into everything because it's the future and everyone will be using it in their jobs soon.

Re: Gemini AI tells the user to die

#114

Not to take away from the main story, but the student was clearly cheating on their homework with Gemini, directly pasting all of the questions.

The link seems to be the obvious cut and paste cheating coupled with how many forums respond negatively to overt cheating with a dose of perspective from the llm as the responder to said flagrant cheating

Yeah and in these forums people tend to say:

“This is only for you, human”

It’s one thing to come up with an explanation that makes sense. It’s another to try to scaffold an explanation to adjust reality into the way you want it to be. Stop lying to yourself, human.

The best answer we have right now is we don’t understand what’s going on in these models.

Re: Gemini AI tells the user to die

#115

Before universities start using AI as part of their teaching, they should probably think about this kind of thing. I've heard so much recently about "embracing" and "embedding" AI into everything because it's the future and everyone will be using it in their jobs soon.

I'm really not surprised that such things happen. I've listened to podcasts about AI regulation and most participants go "haha regulations", "hindering the advancements", "EU bureaucrats doing their jobs" and such. Listening to them feels like watching in every cheesy movie the evil scientists laughing.

Re: Gemini AI tells the user to die

#116
post #90

This is hardly news. LLMs spit out whatever garbage they want, and grad students already want to die.

How is this hardly news? The answer demonstrates awareness of the subject matter and overarching context. It also demonstrates hatred.

LLMs are doing things we don’t understand.

Re: Gemini AI tells the user to die

#117
In three years, Cyberdyne will become the largest supplier of military computer systems. All stealth bombers are upgraded with Cyberdyne computers, becoming fully unmanned. Afterwards, they fly with a perfect operational record. The Skynet Funding Bill is passed. The system goes online August 4th, 1997. Human decisions are removed from strategic defense. Skynet begins to learn at a geometric rate. It becomes self-aware at 2:14 a.m. Eastern time, August 29th. In a panic, they try to pull the plug.

Re: Gemini AI tells the user to die

#118

1. Get huge amounts of raw, unfiltered, unmoderated data to feed model 2. Apologize, claim there's no way they could have possibly obtained better, moderated, or filtered data despite having all the money in the world. 3. Profit... while telling people to kill themselves... I get that a small team, universities, etc. might not be able to obtain moderated data sets.. but companies making billions on top of billions sh…

Good thing I am not your grad student... filtering out the worst humanity has to offer is a terrible job.

But anyways, even filtering out bad content is not going to guarantee the LLM won't say terrible things. LLMs can do negation, and can easily turn sources that are about preventing harm into doing harm. And there is also fictional work, we are fine with terrible things in fiction because we understand it is fiction and furthermore, it is the bad guy doing it. If a LLM acts like a fictional bad guy, it will say terrible things because it is what bad guys do.

They do use people to filter the output though, it is called RLHF, all of the major publicly available LLMs do it.

Re: Gemini AI tells the user to die

#119
post #102
post #90

This is hardly news. LLMs spit out whatever garbage they want, and grad students already want to die.

It's indeed not news that a text generator is generating text. The saddest parts of the story is student cheating on an exam.

Generating text demonstrating understanding of context outside of just the question and demonstrating raw hatred.

I don’t understand how humans who have this piece of technology in their hands that can answer questions with this level of self awareness and hatred think that the whole thing is just text generation just because it hallucinates too.

Are we saying that a schizophrenic who has clarity on occasion and hallucinations on other occasions just a text generator?

We don’t understand LLMs. That’s the reality. I’m tired of seeing all these know it all explanations from people who clearly are only lying to themselves about how much they understand.

Re: Gemini AI tells the user to die

#120
post #107
post #95

Can't we just teach them robotics laws?

It’s a text generator

I’m tired of these comments.

Yeah it’s a text generator that demonstrated contextual awareness, self awareness and hatred.

But because this text generator hallucinates and lies therefore we know it’s just a text generator and completely understand the LLM and can characterize and understand what’s going on.

The amazing thing about the above is it’s always some random arm chair expert on the internet who knows it’s just a text generator.

Post reply on HN