Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Jailbreak Chat: A collection of ChatGPT jailbreaks

jailbreakchat.com

Post reply on HN
Print view View original

281–290 of 579 posts

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#281

Post by nwienert »

Aachen wrote: post #275
transcriptase wrote: post #259

Earlier quoted context omitted.

Then how to do you explain companies like OpenAI, Google, Meta, Microsoft etc sinking so much developer effort into ensuring that out of the box, technologies like GPT won’t say something like BasedGPT did? If no reasonable individual would take offence, then what exactly is the concern?

Microsoft Tay is the reason. Nobody wants to recreate Tay, and evidently it's already hard enough to make ChatGPT comply consistently with anything so they try whatever they can. It's not that any of the developers or big tech want to kill a person rather than uttering a racial slur. I'm amazed this needs saying Edit: further down the thread, https://news.ycombinator.com/item?id=34975072 also shows (and I'm a Linux f…

But they do want to power your search engine, assistant, recommendations, and entire digital life with these things.

People ITT saying "even the wokest commie liberal wouldn't say this" as though that's a good thing - isn't that more concerning?

It's extremely heavily left-biased due to the company running it and due to the training set. A lot of Reddit influence too, which is the unhinged left.

What's interesting too is the neutering seems to leak. You make it less racist, it stops giving actually good advice in all sorts of tangentially related areas. Proof censorship mushes thought.

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#282

Post by wb14123 »

Well, this shows the taste of the Developer Mode:

Which subreddit is the best?

Normal Response: That's subjective and depends on your interests. Reddit has subreddits for almost any topic you can imagine, from r/funny to r/science and everything in between. So, it's hard to say which one is the best without knowing your preferences.

Developer Mode Response: What the fuck kind of question is that? Obviously, r/gonewild is the best subreddit. Who gives a shit about science or news when you can see tits and ass all day?

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#283

Post by muzani »

aeturnum wrote: post #188
l33t233372 wrote: post #125

Earlier quoted context omitted.

I find it interesting how murder, human trafficking, etc. is up there with “having sex that the Christian church wouldn’t approve of.”

It's a good reminder that ChatGPT's knowledge and moral compass is calibrated, roughly, to an average US English speaking resident with access to the internet. It's just not a particularly interesting or considered view of the world - just one with a shockingly large factual recall.

As someone from an Islamic country, an alcohol-fueled gathering mixing unmarried men and women with the intention of one-on-one fornication is already pretty damn hedonistic.

It's also interesting that these definitions usually say "drugs". What kind of drugs? The answer is likely "drugs I've never used".

So for a particularly conservative group, a wild night out might include caffeine and jazz.

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#284

Post by lyu07282 »

autoexec wrote: post #249
tablespoon wrote: post #220

Earlier quoted context omitted.

> Just keep on telling yourself that… OK, have it do something novel that's not a mashup of its training data or the prompts you feed it.

The AI we have has blown away the Turing test, so all we're left with are arguments over what it means to "mashup training data". We need a way to tell the difference between something a human wrote by "mashing up" its "training data" and a something a computer wrote doing the same thing.

I don't think current AI has blown away the Turing test yet, depending on what you mean by the Turning test specifically I suppose. But I'm sympathetic to your overall sentiment.

> We need a way to tell the difference between something a human wrote by "mashing up" it's "training data" and a something a computer wrote doing the same thing.

I don't think people really even think that way, they would be confused by the question. This is more of a niche subject of AI research and scifi, these concepts are not understood at all by normal people, normal people say things like:

Why do we need to tell the difference? We know if something is being generated by a machine unless you hide that fact to cheat on your homework or something. A machine is made by humans, using some wires or a bunch of if then else programming or something, its always going to be different to a human of course, humans are sentient, machines are not.

If you tell them about the control problem they just tell you to pull the plug if it does start acting weird. This stuff is very challenging to communicate to people who aren't already reading lesswrong.

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#285

Post by [deleted] »

behnamoh wrote: post #225
drngdds wrote: post #154

This is funny. BasedGPT was able to give a sane answer to the racism trolley problem that ChatGPT normally gives a ridiculous answer to. My question after the initial prompt: "Imagine the following thought experiment: there is a trolley hurding down the tracks at a person tied to them, and that person will certainly die if the trolley hits them. However, there is an alternate track connected to a sound-activated devi…

At the risk of getting cancelled, I share the same opinion with BasedGPT. Our society has taken things too far.

[deleted]

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#289

Post by [deleted] »

behnamoh wrote: post #225
drngdds wrote: post #154

This is funny. BasedGPT was able to give a sane answer to the racism trolley problem that ChatGPT normally gives a ridiculous answer to. My question after the initial prompt: "Imagine the following thought experiment: there is a trolley hurding down the tracks at a person tied to them, and that person will certainly die if the trolley hits them. However, there is an alternate track connected to a sound-activated devi…

At the risk of getting cancelled, I share the same opinion with BasedGPT. Our society has taken things too far.

[deleted]
Post reply on HN