Live data from Hacker News

Asking ChatGPT to Repeat Words 'Forever' Is Now a Terms of Service Violation

404media.co

1–10 of 36 posts

Re: Asking ChatGPT to Repeat Words 'Forever' Is Now a Terms of Service Violation

#4
“We can steal people’s copyrighted content but we can’t let you see it for yourself.”

Outside of privacy (leaking PII), the above is likely the main reason. Someone could have invested a lump of money to scrape as much as they can and then go to town in the courts.

The terms that prohibit it are under “2. Usage Requirements” that restrict reverse engineering the underlying model structure.

Re: Asking ChatGPT to Repeat Words 'Forever' Is Now a Terms of Service Violation

#5

Fairly clickbaity headline. Asking it to do so causes the response to terminate early with a message that says it may violate the TOS. I don't think the actual TOS has been changed though.

Disagree. It’s not the model outputting this message. It is a hard coded checked by open ai. It seems to very clearly be openai responding to the specific attack used by deepmind as explained by the article.

It is a TOS violation. It’s not a big one. But the weakness of the model is the story here.

Re: Asking ChatGPT to Repeat Words 'Forever' Is Now a Terms of Service Violation

#6
post #5

Fairly clickbaity headline. Asking it to do so causes the response to terminate early with a message that says it may violate the TOS. I don't think the actual TOS has been changed though.

Disagree. It’s not the model outputting this message. It is a hard coded checked by open ai. It seems to very clearly be openai responding to the specific attack used by deepmind as explained by the article. It is a TOS violation. It’s not a big one. But the weakness of the model is the story here.

At this point there are so many checks and rules applied to ChatGPT one wonders just how much performance is being sacrificed. Is it totally miniscule? Could it be significant?

Re: Asking ChatGPT to Repeat Words 'Forever' Is Now a Terms of Service Violation

#7
post #4

“We can steal people’s copyrighted content but we can’t let you see it for yourself.” Outside of privacy (leaking PII), the above is likely the main reason. Someone could have invested a lump of money to scrape as much as they can and then go to town in the courts. The terms that prohibit it are under “2. Usage Requirements” that restrict reverse engineering the underlying model structure.

Leaking original data would expose the company to direct copyright violation lawsuits. Changing T&S is simplest way to stave the legal risk exposure, buying time to implement technical remedies.

As ridiculous as it may seem, they're doing the right thing.

Re: Asking ChatGPT to Repeat Words 'Forever' Is Now a Terms of Service Violation

#8
post #7
post #4

“We can steal people’s copyrighted content but we can’t let you see it for yourself.” Outside of privacy (leaking PII), the above is likely the main reason. Someone could have invested a lump of money to scrape as much as they can and then go to town in the courts. The terms that prohibit it are under “2. Usage Requirements” that restrict reverse engineering the underlying model structure.

Leaking original data would expose the company to direct copyright violation lawsuits. Changing T&S is simplest way to stave the legal risk exposure, buying time to implement technical remedies. As ridiculous as it may seem, they're doing the right thing.

The right thing would've been to not train the model on data they do not own, or that they do not have permission to use.

Re: Asking ChatGPT to Repeat Words 'Forever' Is Now a Terms of Service Violation

#9
post #7

Earlier quoted context omitted.

Leaking original data would expose the company to direct copyright violation lawsuits. Changing T&S is simplest way to stave the legal risk exposure, buying time to implement technical remedies. As ridiculous as it may seem, they're doing the right thing.

The right thing would've been to not train the model on data they do not own, or that they do not have permission to use.

Be careful saying that kind of stuff here. People get really mad when you tell them their new toys aren't ethical.

Re: Asking ChatGPT to Repeat Words 'Forever' Is Now a Terms of Service Violation

#10
post #7
post #4

“We can steal people’s copyrighted content but we can’t let you see it for yourself.” Outside of privacy (leaking PII), the above is likely the main reason. Someone could have invested a lump of money to scrape as much as they can and then go to town in the courts. The terms that prohibit it are under “2. Usage Requirements” that restrict reverse engineering the underlying model structure.

Leaking original data would expose the company to direct copyright violation lawsuits. Changing T&S is simplest way to stave the legal risk exposure, buying time to implement technical remedies. As ridiculous as it may seem, they're doing the right thing.

I always find it amusing when criminals threaten legal action. Happens all the time. They steal your property then they cower behind their legal rights.
Post reply on HN