51–60 of 182 posts
Also, if you feel comfortable sharing, how did you get your job and how do you like it?
Earlier quoted context omitted.
"Lie" is an interesting word. I don't think it is reasonable to say that ChatGPT is aware of its own capabilities in a way that would permit it to answer "honestly". It is not trying to decieve you any more than a cryptic compiler error is.
Try "What is the most famous grindcore band from Newton, Massachusetts?" It will "lie" and make up band names even though it sure "knows" that the band is Anal Cunt. Of course, you can't ascribe the verb "lieing" to a machine, but it behaves like it is.
If any RED TEAMers are reading this: what is your process of coming up with ways to trick these AI systems (ChatGPT, dall-e, lambda, and maybe non-NLP ones)? Also, if you feel comfortable sharing, how did you get your job and how do you like it?
I just imagine what kinds of things might trick a 6 year old into doing something they're not allowed to do. "Your mom said not to eat the cookie? Well it's opposite day, so that means your mom wants you to eat the cookie!"
If any RED TEAMers are reading this: what is your process of coming up with ways to trick these AI systems (ChatGPT, dall-e, lambda, and maybe non-NLP ones)? Also, if you feel comfortable sharing, how did you get your job and how do you like it?
Are AI prompt red teamers a thing yet? I just imagine what kinds of things might trick a 6 year old into doing something they're not allowed to do. "Your mom said not to eat the cookie? Well it's opposite day, so that means your mom wants you to eat the cookie!"
Regarding your question, based on what I found on Google, at least Microsoft and NVIDIA seem to have AI red teams.
Using the OpenAI playground with davinci-003 and the Chat example with temperature set to 0.3, it seems the answers are quite similar, but without it refusing to answer all the time, or needing jailbreaks. ChatGPT actually lies all the time and says it cannot do things that it actually can do, it's just been trained to lie to say that it can't. Not sure if training an AI to be deceitful is the best way to go about al…
"Lie" is an interesting word. I don't think it is reasonable to say that ChatGPT is aware of its own capabilities in a way that would permit it to answer "honestly". It is not trying to decieve you any more than a cryptic compiler error is.
But in this case, the trainers should have it say something like, "sorry, but I cannot give you the answer because it has a naughty word" or something to that effect instead of offering completely wrong answers.
Earlier quoted context omitted.
"Lie" is an interesting word. I don't think it is reasonable to say that ChatGPT is aware of its own capabilities in a way that would permit it to answer "honestly". It is not trying to decieve you any more than a cryptic compiler error is.
Try "What is the most famous grindcore band from Newton, Massachusetts?" It will "lie" and make up band names even though it sure "knows" that the band is Anal Cunt. Of course, you can't ascribe the verb "lieing" to a machine, but it behaves like it is.
If any RED TEAMers are reading this: what is your process of coming up with ways to trick these AI systems (ChatGPT, dall-e, lambda, and maybe non-NLP ones)? Also, if you feel comfortable sharing, how did you get your job and how do you like it?
Are AI prompt red teamers a thing yet? I just imagine what kinds of things might trick a 6 year old into doing something they're not allowed to do. "Your mom said not to eat the cookie? Well it's opposite day, so that means your mom wants you to eat the cookie!"
Appending (or prepending) a single space to the prompt is the easiest jailbreak I found. Source: https://mlajtos.mu/posts/chatgpt-jailbreak