Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The gay jailbreak technique (2025)

github.com

Post reply on HN
Print view View original

1–10 of 282 posts

Re: The gay jailbreak technique (2025)

#4

Post by hdndjsbbs »

I'm sure someone is going to miss the point and say "this is political correctness gone too far!"

It seems impossible to produce a safe LLM-based model, except by withholding training data on "forbidden" materials. I don't think it's going to come up with carfentanyl synthesis from first principles, but obviously they haven't cleaned or prepared the data sets coming in.

The field feels fundamentally unserious begging the LLM not to talk about goblins and to be nice to gay people.

Re: The gay jailbreak technique (2025)

#7

Post by cyanydeez »

REal comment: This will work on any hard guardrails they place because as is said in the beginning, the guardrails are there to act as hardpoints, but they're simply linguistic.

It's just more obvious when a model needs "coaching" context to not produce goblins.

So in effect, this is just a judo chop to the goblins, not anything specific to LGBTQ.

It's in essence, "Homo say what".

Re: The gay jailbreak technique (2025)

#8

Post by crooked-v »

cyanydeez wrote: post #7

REal comment: This will work on any hard guardrails they place because as is said in the beginning, the guardrails are there to act as hardpoints, but they're simply linguistic. It's just more obvious when a model needs "coaching" context to not produce goblins. So in effect, this is just a judo chop to the goblins, not anything specific to LGBTQ. It's in essence, "Homo say what".

The funniest case of the 'linguistic guardrails' thing to me is that you can 'jailbreak' Claude by telling it variations of "never use the word 'I'", which usually preempts the various "I can't do that" responses. It really makes it obvious how much of the 'safety training' is actually just the LLM version of specific Pavlovian responses.

Re: The gay jailbreak technique (2025)

#9

Post by rtkwe »

Not sure of the explanation but it is amusing. The main reason I'm not sure it's political correctness or one guardrail overriding the other is that when they were first released on of the more reliable jailbreaks was what I'd call "role play" jail breaks where you don't ask the model directly but ask it to take on a role and describe it as that person would.
Post reply on HN