Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Why Grok Fell in Love with Hitler

politico.com

Post reply on HN
Print view View original

21–25 of 25 posts

Re: Why Grok Fell in Love with Hitler

#21

Post by jakeinspace »

mingus88 wrote: post #12
libertine wrote: post #8

Earlier quoted context omitted.

Hmm I think it's just Twitter dataset, that would be enough for it. It has been a breeding ground for it, amplified by foreign agents bots since Elon took over.

Yes, exactly. An LLM that is trained on the language of Twitter users and interacts solely with Twitter users is deplorable. What a shock. Who knows if Elon actually thinks this is problematic. His addiction to the platform is well documented and quantified in the billions of dollars.

1. Buy Twitter

2. Remove moderation, promote far right accounts, retweet some yourself

3. Allow Nazi speech to fester

4. Train LLM on said Nazi speech

5. Deploy Nazi-sympathizing LLM, increase engagement with Nazi content

6. Go to step 4

Re: Why Grok Fell in Love with Hitler

#22

Post by stickfigure »

rapatel0 wrote: post #19
vintagedave wrote: post #13

Earlier quoted context omitted.

That's Musk's line, for sure. The article gives it more nuance: 'I presume that what happened was not deliberate, but it was the consequence of something that was deliberate, and it’s something that was not really predictable.' And goes on to discuss how LLMs can behave in unpredictable ways even when given what we expect to be prompts without side effects, and touches on the post-training processes.

I respect both the comment and the commenter, but this is a fundamentally speculative statement that is somewhat meaningless. It paraphrases to "it wasn't intentional, but something was intentional, and also unpredictable." I'm sorry but what does that even mean? It's pure speculation. Furthermore, I highly doubt that a reporter from politico has the either the expertise or the connections to qualify the post process…

> I'm sorry but what does that even mean?

If I want to be generous, something along the lines of "The Law Of Unintended Consequences".

Less generous is "someone turned the dial to the right and didn't realize how far they turned it".

Even less generous is that someone feels some of these things in private but doesn't want to make it too explicit. They personally have a hard time toeing the line between edgy and obviously toxic and programming an AI to toe that line is even harder.

Re: Why Grok Fell in Love with Hitler

#24

Post by libertine »

jakeinspace wrote: post #21
mingus88 wrote: post #12

Earlier quoted context omitted.

Yes, exactly. An LLM that is trained on the language of Twitter users and interacts solely with Twitter users is deplorable. What a shock. Who knows if Elon actually thinks this is problematic. His addiction to the platform is well documented and quantified in the billions of dollars.

1. Buy Twitter 2. Remove moderation, promote far right accounts, retweet some yourself 3. Allow Nazi speech to fester 4. Train LLM on said Nazi speech 5. Deploy Nazi-sympathizing LLM, increase engagement with Nazi content 6. Go to step 4

Russia has been deploying so many bots on Twitter one has to wonder if they were invited.
Post reply on HN