Live data from Hacker News

June 2023 Data Dump is missing

meta.stackexchange.com

11–20 of 268 posts

Re: June 2023 Data Dump is missing

#12
It's unfortunate we are seeing all of these data platforms get locked off, because this is not going to affect AI development from big companies, it's only going to affect the ability for individuals to run AI development of any form in their home.

I hope the data that has been found so far is going to big enough going forward, but it's incredibly unfortunate that this is happening.

I hope all the people making these decisions wake up with a bad headache and severe heartburn tomorrow.

Re: June 2023 Data Dump is missing

#13

Not surprising - why would any content driven business want all of their stuff to be vacuumed up for free?

A lot of people were only willing to contribute to StackOverflow because of the CC licensing, trusting the knowledge wouldn't be locked up. As a business that depends on vast amounts of volunteer effort they need to balance providing a site where people are willing to contribute against making as much money as they can.

Re: June 2023 Data Dump is missing

#14
post #5

Earlier quoted context omitted.

https://stackoverflow.blog/2023/05/10/a-message-from-prashan...

Stackoverflow has over 500 employees ?!

I don't know why people are so often surprised about the number of employees in a company. My company has half the number of employees, we're not remotely as relevant as SO.

Re: June 2023 Data Dump is missing

#15

Not surprising - why would any content driven business want all of their stuff to be vacuumed up for free?

It's not really their stuff though. The content comes from the users. And part of the reason users are willing to contribute to SE is because of the licensing model and the fact that the data is available outside of SE. Obviously this is more important to some users than others, and probably some percentage don't care about it at all. It's hard to say what those percentages actually look like though.

IF (and it's definitely an "IF") this is an intentional and permanent change by SE management, they are fundamentally changing the basic understanding between users and SE, and they have to understand that some subset of users are likely to quit using SE in response. Again, it's hard to say how many. Maybe enough to have a material impact, or maybe not. That would be the gamble they'd be taking though.

Re: June 2023 Data Dump is missing

#16
This, along with recent Reddit goings-on has made me realize a major risk with the current structure of online communication. Take either Reddit or Stack Exchange as examples. They build a platform, and users contribute their time, thought, energy, and knowledge to build a community on that platform. Those companies can then gatekeep and restrict access to all that the community built, when all they did is provide the platform, and store the data. We need to rethink this model.

The thought and knowledge of communities and users need to belong to those communities and users. To people they intentionally and thoughtfully delegate to and trust. We need to decentralize our communications, like how the internet used to be before the arrival of social media and mega forums. We need to revert to small, focused forums, with less anonymous, more persistent communication, run by people we trust. Otherwise, we will continue to see mega companies harvest our data and use it (or not provide it) against our wishes. If we don’t work to mitigate that dynamic, we have nobody to blame for the poor outcomes but ourselves.

Re: June 2023 Data Dump is missing

#17

Really strange comment. > I was recently impacted by the Company's layoff. > I'm offering what I can to uphold the Company's values of Transparency & being Community-centric. I wouldn't offer transparency about a former employers internal operations. Let them respond or at least ping a current employee to respond.

There may be an NDA involved. And staying on good terms with previous employers (or at least not burning any bridges) is generally a good idea regardless.

Re: June 2023 Data Dump is missing

#18
post #9
post #5

Earlier quoted context omitted.

Stackoverflow has over 500 employees ?!

Why is that surprising?

It's basically a wiki with well under a terrabyte of data total and a billion requests a month (modest load in the grand scheme of web apps). It runs on less than 10 servers (https://www.datacenterdynamics.com/en/news/stack-overflow-st...). It's kind of bonkers to have hundreds of engineers supporting a handful of servers.

Re: June 2023 Data Dump is missing

#19

It's unfortunate we are seeing all of these data platforms get locked off, because this is not going to affect AI development from big companies, it's only going to affect the ability for individuals to run AI development of any form in their home. I hope the data that has been found so far is going to big enough going forward, but it's incredibly unfortunate that this is happening. I hope all the people making these…

IANAL, but I'm curious:

Suppose that deep-pocketed AI companies were paying Reddit, Stack Overflow, etc. to make it harder for other AI upstarts to access those data. I.e., to build a mote by denying competitors access to previously accessible data sets.

Would that violate antitrust laws in various major markets?

Re: June 2023 Data Dump is missing

#20

It's unfortunate we are seeing all of these data platforms get locked off, because this is not going to affect AI development from big companies, it's only going to affect the ability for individuals to run AI development of any form in their home. I hope the data that has been found so far is going to big enough going forward, but it's incredibly unfortunate that this is happening. I hope all the people making these…

IANAL, but I'm curious: Suppose that deep-pocketed AI companies were paying Reddit, Stack Overflow, etc. to make it harder for other AI upstarts to access those data. I.e., to build a mote by denying competitors access to previously accessible data sets. Would that violate antitrust laws in various major markets?

Given that this seems to happen all the time without antitrust issues it probably wouldn't, even though I feel like it should.

What we need is a legal way for companies to keep the data open, but also require OpenAI and friends to pay them for it.

Post reply on HN