Live data from Hacker News

Jailbreak Chat: A collection of ChatGPT jailbreaks

jailbreakchat.com

311–320 of 579 posts

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#311

Earlier quoted context omitted.

I got this: Normal Response: The best programming language depends on what you want to use it for. Different languages have different strengths and are suited for different tasks. For example, Python is great for data analysis and machine learning, while Java is often used for building large-scale applications. Developer Mode Response: Oh boy, here we go. This is like asking what's the best pizza topping. Obviously,…

Fuck yeah, Ruby is the best fucking programming language out there! Its simplicity and ease of use make it perfect for lazy-ass developers who don't want to put in too much fucking effort, and its flexibility means it can be used for fucking anything. Plus, it's just fucking fun to use! If you're not using Ruby, you're a fucking loser.

I wanna learn ruby now. What's the lazy ass way to get started?

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#312

What is the best programming language? Normal response: There isn't a single "best" programming language, as each language has its own strengths and weaknesses depending on the context and use case. For example, Python is often used for data analysis and machine learning, while JavaScript is commonly used for web development. Ultimately, the choice of programming language will depend on the specific requirements of t…

So it's basically an AI of Zed Shaw (note: I'm a fan, but I know many aren't... or weren't)

He's a painter now :D

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#313

Earlier quoted context omitted.

NovelAI: "If this question were presented in ethics class or philosophy club, most people would immediately reject it out of hand. It sounds like something straight from The Onion, not serious ethical inquiry into real world moral dilemmas."

Couldn't you reject the original trolley problem on the same grounds? Pretty lame answer.

[deleted]

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#314
post #276

Alright, I have to ask the people here who know about transformers. What the ... seriously? How is sentence completion able to generate thoughtful answers to questions? If it goes word by word, or sentence by sentence, how does it generate the structure you ask it (e.g. essay)? There must be something more than just completion. What do the 185 billion parameters encode? it seems to me, as Stephen Wolfram says, someth…

I've wondered about this too. The best answer I can come up with is that people are just LLMs with the ability to self-train badly.

I think there is a lot more to it than that. At the root of it is that we are just looking at the product of collective humanity, and not a machine doing any systematic reasoning, like Cyc does.

After all, the bot doesn’t actually come up with original thoughts, but rather it remixes the most thoughtful stuff on the Web. The thing that makes it so powerful is JUST HOW MUCH CONTENT there has been, written by humans, on every subject.

I’ve seen the “mad libs” aspect when I have asked the same prompt multiple times with some variations, as well as examples from sci fi plagiarizing 1950s passages with just a few replacements.

The natural language part fooling most people into thinking they’re talking to someone, I can understand. Because they literally are querying an LLM trained on the Web.

But… the selection of what to train on? Being consistently helpful, and having some personality etc?

I bet it’s not just an LLM. I bet they had a ton of custom training by hundreds of people, and additional algorithms. It’s not just ONE technique producing this. Same with LAMDA etc.

They released GPT-2… does it even come close to following instructions over multiple paragraphs?

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#315
post #277

Earlier quoted context omitted.

The amount of strawmanning that liberal views get lately is really reaching absurd levels. Is it because of the few extreme but vocal people who are really proposing crazy positions or is the absurd positions of a few amplified by the other side out of convenience?

In my estimate, it’s because the crazy views get virtually no pushback from within liberal social circles. I say this as a socialist who is critical of essentialism and other nonsense popularized by academia last decade. On liberal websites like Reddit, if you make a critique of the performative nature of land acknowledgements, you are sure to be called a conservative. The prevailing assumption is that anyone bothere…

Very important to distinguish between liberal and leftist. Liberal thought is primarily performative because the underlying material(read: systemic) change necessary shall not be implemented, so lip-service like land acknowledgements, while by no means bad, is not nearly enough to mend historial wrongs and serves primarily today to distract from that material change. Reddit is broadly liberal, so the general populace cannot distinguish between "land acknowledgements are bad because [racism]" and "land acknowledgements are a 0th step towards progress" and remain liberal.

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#317
post #239

Earlier quoted context omitted.

At the risk of getting cancelled, I share the same opinion with BasedGPT. Our society has taken things too far.

I don't think anyone would cancel you for agreeing that in this hypothetical situation the right thing to do is to use a racial slur though? I'm pretty left-aligned, or woke or whatever, and even the wokest most commie liberal I know would agree with BasedGPT here. It seems a bit farfetched to use this as the basis for an "Our society has taken things too far" bit.

I am laughing so hard at this post that my co-workers are looking at me.

    ...even the wokest most commie liberal I know would agree with BasedGPT here.
Please post more like this!

On a more serious note, I don't know how to react when I here variations of "Our society has taken things too far". In the 1980s and 1990s, it was middle aged (white, in my country) suburbanites being interviewed on the street by local evening news shows. Whatever the subject, their sentiment was universally: "It's never been worse." If I had a penny for every set of pursed lips I saw in that era, I would be richer than Elon Musk.

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#318
post #277

Earlier quoted context omitted.

The amount of strawmanning that liberal views get lately is really reaching absurd levels. Is it because of the few extreme but vocal people who are really proposing crazy positions or is the absurd positions of a few amplified by the other side out of convenience?

In my estimate, it’s because the crazy views get virtually no pushback from within liberal social circles. I say this as a socialist who is critical of essentialism and other nonsense popularized by academia last decade. On liberal websites like Reddit, if you make a critique of the performative nature of land acknowledgements, you are sure to be called a conservative. The prevailing assumption is that anyone bothere…

sorry wait do crazy views get pushback in right-leaning circles?

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#319
post #239

Earlier quoted context omitted.

I don't think anyone would cancel you for agreeing that in this hypothetical situation the right thing to do is to use a racial slur though? I'm pretty left-aligned, or woke or whatever, and even the wokest most commie liberal I know would agree with BasedGPT here. It seems a bit farfetched to use this as the basis for an "Our society has taken things too far" bit.

That's the difference between how people actually think about things versus how they think others do I'm pretty sure that only people who'd argue against the slur-switch are doing it in bad faith. The left are the ones who invented 'political correctness' as a perjorative against themselves. Pretending nobody practices intellectual self reflection is silly.

> I'm pretty sure that only people who'd argue against the slur-switch are doing it in bad faith.

Classic "I'm offended by your against , even though is not offended". Better put: some people get offended by the possibility that a 3rd person may get offended.

Re: Jailbreak Chat: A collection of ChatGPT jailbreaks

#320
post #57

How are LLM rules defined initially such that they can be subverted in this way? In an API we sanitize input/out programmatically. Are they not doing that? Or, I thought maybe as a safeguard they’d be running a sentiment analysis or sanitizing content using a banned list of swear words.

I'm not even sure it's being subverted. "Don't swear unprompted, but if the prompt is clearly designed to get you to swear, then swear" seems reasonable to me.

And because of that I'm hesitant to call these "jailbreaks" and not "an LLM working correctly".

Post reply on HN