For all the people here alleging that AI companies will train on your data even when you as a user explicitly opt out of training and their terms say they will respect that, etc - do you also believe that within a few years of them having harvested your data, you could perform "knowledge probing" on their models by prompting various questions that determine if they can near-verbatim reproduce your unique data, and then have enough other people do the same that you can then just launch a class-action lawsuit? Because if not... I've got a startup idea for you.
Can I opt out of my input or output data being used for training?
171–180 of 262 posts
Re: Can I opt out of my input or output data being used for training?
#172Earlier quoted context omitted.
It would be catastrohic for any of the big labs if it came out that they were training on what was sold as private. I get this cynical conspiratorial energy, it fits the internet well, but I can assure you most people with even mild business sense would be intensely opposed to this idea. Well, except maybe Zuckerburg, but they don't really do enterprise anyway.
No it wouldn't. It wasn't "catastrophic" for the largest of the 3 US credit reporting agencies when their entire dataset was breached. The company is 100% IP and the only value they have was completely copied. Their largest value is to verify identities by the things Americans know (KDB) and after that "single factor of identity" was 100% compromised, the company only got bigger and more contracts. When there are onl…
that was accidental? this would be straight up fraud.
Re: Can I opt out of my input or output data being used for training?
#173Earlier quoted context omitted.
It would be catastrohic for any of the big labs if it came out that they were training on what was sold as private. I get this cynical conspiratorial energy, it fits the internet well, but I can assure you most people with even mild business sense would be intensely opposed to this idea. Well, except maybe Zuckerburg, but they don't really do enterprise anyway.
No it wouldn't. It wasn't "catastrophic" for the largest of the 3 US credit reporting agencies when their entire dataset was breached. The company is 100% IP and the only value they have was completely copied. Their largest value is to verify identities by the things Americans know (KDB) and after that "single factor of identity" was 100% compromised, the company only got bigger and more contracts. When there are onl…
The credit reporting agencies lost the data of normal people, they didn’t lose their customers proprietary internal data. The credit agencies didn’t loose or misplace their customers data, so obviously their customers don’t really care that much, and the credit agencies weren’t sued into oblivion.
But I can guarantee you that if a companies internal data got leaked or misused, then every single enterprise customer of that lab would turn around and start suing them. As an enterprise customer you would be foolish not to, if only if figure out via discovery just how badly you got screwed.
You want to see how nasty that can get. Just go and look at what Apple is doing to OpenAI at the moment. Do you really think Apple wouldn’t find a way to sue a lab into oblivion if they discovered a lab had secretly started training on their data?
Re: Can I opt out of my input or output data being used for training?
#174Earlier quoted context omitted.
No it wouldn't. It wasn't "catastrophic" for the largest of the 3 US credit reporting agencies when their entire dataset was breached. The company is 100% IP and the only value they have was completely copied. Their largest value is to verify identities by the things Americans know (KDB) and after that "single factor of identity" was 100% compromised, the company only got bigger and more contracts. When there are onl…
that was accidental? this would be straight up fraud.
You can structure it so that it becomes accidental.
1. Ensure security barriers are weak or honor based.
2. Put individual researchers under a lot of pressure.
3. If you get caught, blame the weak barriers, or the individual researcher.
Re: Can I opt out of my input or output data being used for training?
#175> users are not opted out by default
Of course because you can’t be opt out by default that would be called opt in.
Re: Can I opt out of my input or output data being used for training?
#176Context: After careful research our organization preferred a European partner with good central privacy controls. We landed on Mistral, after being disappointed that the Pro tier was opt-in to training on prompts by default we switched up to the Team tier which provides an organization dashboard with some relevant settings. As we did that Mistral changed these options and the Team tier was now also opt-in by default…
I don't trust any of these companies with my data, and I assume that whatever data they've got is going to be used, one way or another, no matter what they tell you. It would be nice if you could stick a sentinel in your data that if it ever shows up in the models you know they've broken the rules for sure.
Re: Can I opt out of my input or output data being used for training?
#177Earlier quoted context omitted.
If you opt in it means that by default you're not in and you chose that option. So if you're now included in training by default, then it's an opt-out feature as in you can opt out of it.
Idk, feels like my brain does not have the model for this, this does not exist in my language afaik haha.
Opt-in = "we assume you are out unless you tell us you want to be in"
Opt-out = "we assume you are in unless you tell us you want to be out"
Re: Can I opt out of my input or output data being used for training?
#178Context: After careful research our organization preferred a European partner with good central privacy controls. We landed on Mistral, after being disappointed that the Pro tier was opt-in to training on prompts by default we switched up to the Team tier which provides an organization dashboard with some relevant settings. As we did that Mistral changed these options and the Team tier was now also opt-in by default…
I don't trust any of these companies with my data, and I assume that whatever data they've got is going to be used, one way or another, no matter what they tell you. It would be nice if you could stick a sentinel in your data that if it ever shows up in the models you know they've broken the rules for sure.
Yeah. Unfortunately they know you can't catch them on this so they feel absolutely free to do whatever they please
If such a data sentinel did exist then we might see them change their behavior
Re: Can I opt out of my input or output data being used for training?
#179You have to be rather naive if you don't think these companies don't simply train on your prompts with or without your consent. They literally scrape everything - legal or not - and claim its fair use to train on, including straight piracy The idea that they'll steal from everyone except you is just wishful thinking
Re: Can I opt out of my input or output data being used for training?
#180I'd like to provide extra context to help with training. Like, here's my codebase and the logs and the docs, feel free to ask me questions about it... Whatever makes the next version more applicable to the problems I'm trying to solve would be excellent.
I just wish I could force them to share it with their competitors also.