Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Stack Overflow has stopped publishing data dumps to the Internet Archive

meta.stackexchange.com

Post reply on HN
Print view View original

11–20 of 20 posts

Re: Stack Overflow has stopped publishing data dumps to the Internet Archive

#11

Post by odo1242 »

fragmede wrote: post #7
Noble6 wrote: post #6

The rationale obviously points to stack exchange blocking AI from training off their content on archive.org. They go on to demand adherence to “socially responsible” AI training which requires cash-flow between AI companies and the data sources they train from. First, and most obviously, stack exchange does NOT own the forum content. It has been provided for FREE by the larger developer community, and that same commu…

You did read the TOS where you agreed that they DO own the content, yeah?

They don't own the content according to the TOS, they get a license to use it (the Creative Commons Attribution-ShareAlike 4.0 license). They could still use it for AI training, but the model would have to be CC BY-SA 4.0 (not that AI companies care).

This definitely forbids the "I will not transfer it to others without permission from Stack Overflow" checkbox, as the CC BY-SA 4.0 license says "You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits."

Re: Stack Overflow has stopped publishing data dumps to the Internet Archive

#12

Post by kmontrose »

fragmede wrote: post #7
Noble6 wrote: post #6

The rationale obviously points to stack exchange blocking AI from training off their content on archive.org. They go on to demand adherence to “socially responsible” AI training which requires cash-flow between AI companies and the data sources they train from. First, and most obviously, stack exchange does NOT own the forum content. It has been provided for FREE by the larger developer community, and that same commu…

You did read the TOS where you agreed that they DO own the content, yeah?

The Stack Exchange TOS ( https://stackoverflow.com/legal/terms-of-service/public ) doesn't assign ownership - posters retain copyright, SO gets a non-exclusive license to it, and everybody else gets it under various CC wiki terms.

Re: Stack Overflow has stopped publishing data dumps to the Internet Archive

#13

Post by abdullahkhalids »

philipwhiuk wrote: post #10
fragmede wrote: post #7

Earlier quoted context omitted.

You did read the TOS where you agreed that they DO own the content, yeah?

Actually no, we agree to provide it under two licenses, one of which is CC-BY-SA. We don't give them ownership, we give them irrevocable usage rights. > You agree that any and all content, including without limitation any and all text, graphics, logos, tools, photographs, images, illustrations, software or source code, audio and video, animations, and product feedback (collectively, “Content”) that you provide to the…

Yes, but does that mean that SO is obligated to share the data with AI companies?

I know that the CC-BY-SA [1] says

> No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.

But I don't know if it is relevant here.

[1] https://creativecommons.org/licenses/by-sa/4.0/

Re: Stack Overflow has stopped publishing data dumps to the Internet Archive

#14

Post by CamperBob2 »

Noble6 wrote: post #6

The rationale obviously points to stack exchange blocking AI from training off their content on archive.org. They go on to demand adherence to “socially responsible” AI training which requires cash-flow between AI companies and the data sources they train from. First, and most obviously, stack exchange does NOT own the forum content. It has been provided for FREE by the larger developer community, and that same commu…

Developers are the real victims here

Yes, with the promise of access to godlike oracles that the ancient Greeks couldn't have imagined, we're the real victims here.

Re: Stack Overflow has stopped publishing data dumps to the Internet Archive

#15

Post by fragmede »

philipwhiuk wrote: post #10
fragmede wrote: post #7

Earlier quoted context omitted.

You did read the TOS where you agreed that they DO own the content, yeah?

Actually no, we agree to provide it under two licenses, one of which is CC-BY-SA. We don't give them ownership, we give them irrevocable usage rights. > You agree that any and all content, including without limitation any and all text, graphics, logos, tools, photographs, images, illustrations, software or source code, audio and video, animations, and product feedback (collectively, “Content”) that you provide to the…

That's just nitpicking on the definition of "do" and "own" though.

Re: Stack Overflow has stopped publishing data dumps to the Internet Archive

#16

Post by toomuchtodo »

abdullahkhalids wrote: post #13
philipwhiuk wrote: post #10

Earlier quoted context omitted.

Actually no, we agree to provide it under two licenses, one of which is CC-BY-SA. We don't give them ownership, we give them irrevocable usage rights. > You agree that any and all content, including without limitation any and all text, graphics, logos, tools, photographs, images, illustrations, software or source code, audio and video, animations, and product feedback (collectively, “Content”) that you provide to the…

Yes, but does that mean that SO is obligated to share the data with AI companies? I know that the CC-BY-SA [1] says > No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits. But I don't know if it is relevant here. [1] https://creativecommons.org/licenses/by-sa/4.0/

It just means others will scrape and push into the Internet Archive (or publish torrents). They aren’t obligated, but they also have little control regardless of gating mechanisms.

Re: Stack Overflow has stopped publishing data dumps to the Internet Archive

#17

Post by luke-stanley »

"Stack Overflow is no longer uploading the data dump to archive.org." "We would really rather users do not upload the file to archive.org or similar data pile sites." They have no way to stop people from doing that under the license. Only kind words. Since they've made it deliberately hard for people to train on, I'd be really surprised if people didn't put it on Archive.org and HuggingFace Datasets. So long as it's under the license, it should be fine, right? I am not a lawyer. What they said about access speed issues makes little sense to me, I torrented their dumps before just fine and was very happy to seed it.

Re: Stack Overflow has stopped publishing data dumps to the Internet Archive

#18

Post by luke-stanley »

precommunicator wrote: post #5

I wonder if archives downloaded by two different people have different checksums? That would mean they have hidden a paper town (fake entry/signature) somewhere. I would be surprised if that's not the case, or will be the case.

There would be no benefit to doing that since free accounts can access it.

Re: Stack Overflow has stopped publishing data dumps to the Internet Archive

#19

Post by [deleted] »

luke-stanley wrote: post #18
precommunicator wrote: post #5

I wonder if archives downloaded by two different people have different checksums? That would mean they have hidden a paper town (fake entry/signature) somewhere. I would be surprised if that's not the case, or will be the case.

There would be no benefit to doing that since free accounts can access it.

[deleted]

Re: Stack Overflow has stopped publishing data dumps to the Internet Archive

#20

Post by philipwhiuk »

fragmede wrote: post #15
philipwhiuk wrote: post #10

Earlier quoted context omitted.

Actually no, we agree to provide it under two licenses, one of which is CC-BY-SA. We don't give them ownership, we give them irrevocable usage rights. > You agree that any and all content, including without limitation any and all text, graphics, logos, tools, photographs, images, illustrations, software or source code, audio and video, animations, and product feedback (collectively, “Content”) that you provide to the…

That's just nitpicking on the definition of "do" and "own" though.

All law is nitpicking.
Post reply on HN