Earlier quoted context omitted.
[flagged]
I didn't know, what can I read about this?
June 2023 Data Dump is missing
221–230 of 268 posts
Re: June 2023 Data Dump is missing
#222Is this such a big problem? You could still scrape all the data, or not?
For those who downvote me, can you explain? I'm really curious on the answer of the question. I don't really understand what the problem is. The data stays under the same licence anyway, so scraping it shouldn't really be any issue.
Re: June 2023 Data Dump is missing
#223Re: June 2023 Data Dump is missing
#224Earlier quoted context omitted.
> None of the contributors (apart from the employee ones, I suppose) ever got paid any currency other than high-fives in the form of rep, medals, the gamified stuff, moderation rights, and at certain rep levels some swag in the form of t-shirts and the usual. I would love to see some kind of identity and reputation system where the "high-fives in the form of rep" could follow people across communities. It may not fee…
> I would love to see some kind of identity and reputation system where the "high-fives in the form of rep" could follow people across communities. It may not feel like much compensation if you've contributed over 2500 answers, but having reputation gained in your area of expertise grant you a high level of trust to interact in other communities could be valuable, at least in my opinion. Honestly I think that's an ex…
> I think that "quality" will be really, really hard to objectively measure in the near future as the whole world of digital information becomes tainted with applied statistical models which can do a reasonably good job of predicting what people perceive to be high-quality reasoning, answers, content.
That's the scariest thing I've heard today. Lol.
Even now, I think the proper use of grammar and spelling alongside assertive language has a lot of people fooled into thinking LLMs are actually intelligent. It's hard to explain to people how the LLMs know everything and understand nothing.
I've been bullish on the idea of using domains as identity for a long time. I think by using them as a universal ID you could build reputation and trust across the internet and that helps everyone a lot when trying to assess the reliability of information. If you add in attestations for factual info it gets even more interesting. Ex: GitHub attests user @john.example.com has 1000 commits to the XYZ project. Suddenly you have a more reliable way of ranking John's comments about XYZ as a topic, regardless of where they show up (as long as those identities are validated somehow).
If you look at that as "ranking people" and judge it in the context of being a valuable piece of input for LLMs/AIs, the big push for "better" identity systems like "Passwordless" start to look like a hell of a coincidence. My cynical side wonders if we'll see a push for validated (via government ID) identity systems. Something as simple as a "real human from Canada" tag would provide immense value for AI training (and marketing).
No matter what, I think AI is going to cause changes in the way online identity and reputation work. I think if it evolves into some kind of system with domains as identity it'll be decentralized and provide long term benefit. I think if we see something with verified IDs controlled by the current big tech companies it could devolve into something disappointing or even detrimental for the average user.
Re: June 2023 Data Dump is missing
#225Not sure if this is relevant, but the Hacker News BigQuery dataset also stopped updating since Nov 2022: https://issuetracker.google.com/issues/261579123
Re: June 2023 Data Dump is missing
#226What irks me about this is that 100% of their data is provided for free, by the community that they have fostered, the people like myself who have answered > 2500 questions[0], and now SO feels hard-done-by by LLMs using all their hard work to create tools like CodeGPT, GitHub copilot, etc. Were it really a site for helping developers to improve their skills and increase their productivity through the give-and-take m…
I think I see. The economies of the internet are changing. Now with LLMs being accessible at an exponentially cheaper rate, we're seeing old models crumble and new models rising. The era of moderated user content is changing drastically and the stalwarts of social networking, or adjacent, services are closing ranks to try and anticipate the change. Thanks for the insight. I had a vague notion that these new policies…
Absolutely, and very well put. The costs are pretty close to zero at this point for something that would have been mostly considered, publicly at least, as science fiction just a year ago. It's what the printing press was to the scribe, only way, way more disruptive. I don't know if I'm correct here, but that is what it looks like right now and we're basically still at year zero. I mean, it even got the Google all riled up. The company which basically equates to "The Internet" is having to react, I'm pretty sure that's the first time I've seen such a thing in my life. It goes way beyond their reaction to the iPhone, way beyond the threat of MS exercising their monopoly(ish) power back in the day to try to mitigate the Google threat.
History repeats itself albeit in a fascinating way which I'm still trying to grasp.
I don't blame SO. I think they are acting rationally and as anyone would facing such a threat.
Secretly, I want the internet ad economy of nothing to go away. I won't mention any names (cough taboola cough cough) but that might be the only upside to this tech. Let's see what happens six months or so from now.
Side note, I'm running llama on a really crappy old server and that was enough to convince me that I'll be able to run an LLM on my watch in the near future.
Re: June 2023 Data Dump is missing
#227This, along with recent Reddit goings-on has made me realize a major risk with the current structure of online communication. Take either Reddit or Stack Exchange as examples. They build a platform, and users contribute their time, thought, energy, and knowledge to build a community on that platform. Those companies can then gatekeep and restrict access to all that the community built, when all they did is provide th…
The world keeps going dark. What a terrible era.
Re: June 2023 Data Dump is missing
#228[flagged]
I mean it's the same with HN. I'm here for the comments. I could get articles on another news aggregator.
Re: June 2023 Data Dump is missing
#229Earlier quoted context omitted.
I always wonder why original founders just sell the company and do something else. Why don't they try to control it more and make sure it stays aligned with needs of society more? Either they can't because of shareholder/equity owners pressure, or they won't, because they really don't care and just said it for PR
Because despite claims to the contrary most of these sites/projects aren't created for altruistic reasons, they were created to make money (at some point). Cashing out is typically part of the long term plan. In the case of Stack Overflow, I think the reason for the data dumps was two-fold: one of the original founders (who left long ago) came across as at least idealistic and wanting to do the right thing. The other…
The thing is, I sympathize with them not wanting machine learning companies to make money off the site’s content without any benefit to the contributors, moderators, or the site itself. I worry that gating access won’t really change that and just mean that the site owners also benefit at the expense of the community.
Re: June 2023 Data Dump is missing
#230Earlier quoted context omitted.
This was one of the promises originally of Stack Overflow: all the content is Creative Commons licensed so that if they "turned evil" (I believe it was Joel that put it this way) the community could, in a way, create a fork. https://web.archive.org/web/20230203170609/https://stackover... Unfortunately the dumps themselves are not a legal requirement, just a gentleman's agreement, so realistically exercising this abil…
Maybe just a gentlemen's agreement, but a nice canary too. Once the dumps stop, it's time to start waving middle fingers and GTFO.
I stopped answering questions when Monica got sacked as a moderator:
https://meta.stackoverflow.com/questions/393046/who-or-what-...
To me, this was the canary. Just another psychopath megacorp.