Live data from Hacker News

What AI did to stackoverflow in a graph

data.stackexchange.com

531–540 of 615 posts

Re: What AI did to stackoverflow in a graph

#531

Any social organization needs to carefully consider their inclusion-exclusion curve with intentionality. I think a lot of people might balk at the word "inclusivity" today, but StackExchange had ridiculously high barriers to participation, making it inclusive to the long-time users on the site, but exclusive to the newbie participants who found themselves blocked for asking questions. They slowly killed the site in t…

Stack Exchange has degenerated to the point of overt deletionism . It wasn't enough to just close the questions, they actually felt the need to delete the content people put effort into writing as well. There's nothing quite like trying to find a closed question that nonetheless had useful answers and comments with links, only to find that the entire thing had been deleted . They even do this in those beta sites whic…

They'd even delete chats. You'd see, in comments, someone inviting the author to chat, but the link would (in the present) take you to a 404 page. Did the question get an answer? Did chat ever work? Was something useful shared? We'll never know.

Re: What AI did to stackoverflow in a graph

#534
post #89

I never had an LLM tell me my question was already answered and imply I was stupid for not finding it. SO dug its own grave and jumped in.

I see people talking about the negative experiences, and I'm sure they are real, but I also had some very positive experiences. I remember being amazed that some internet stranger took the time to understand my question and provide some great solution where I was stuck. It gave me a little encouragement and social connection as I plugged away on a project alone. I miss that feel good human connection when an LLM can…

[deleted]

Re: What AI did to stackoverflow in a graph

#535
post #323

Earlier quoted context omitted.

> The same thing is happening to Wikipedia, BTW, which is also aggressively moderated [citation needed] Well here it is, and you're wrong: https://en.wikipedia.org/wiki/Wikipedia:Statistics The article creation and edits curves are stable. The former growing at a slightly declining pace, which is expected since the amount of knowledge is finite. The latter is literally flat. The monthly page views are in decline on m…

> The article creation [...] growing at a slightly declining pace, which is expected since the amount of knowledge is finite. Not just because of that, but they also made the process of creating new articles very hostile. Decades ago, when Wikipedia started, it was possible to create a short article, and as long as no one objected against it, it stayed there, and people could later expand it. That's what "wiki" was s…

I've had my share of battles on WP to preserve content that was dismissed as fringe by people who didn't understand what they were looking at (see e.g. https://en.wikipedia.org/wiki/Wikipedia:Files_for_deletion/2...).

The author you mentioned may not have met the inclusion criteria at the time, or maybe you had the misfortune to fall on a zealous admin who gets dopamine kicks from that kind of behavior. That being said, if a cursory Google search was enough to establish notability, it shouldn't have taken much time and effort to add links to reliable sources and save the article.

WP is very sensitive regarding inclusion criteria for biographies of living persons, because of the flood of vanity submission they have to filter out. The notability criteria are not perfect, but the provide a good enough balance to limit the spam (https://en.wikipedia.org/wiki/Wikipedia:Notability_(people)#...).

In my experience, toxic behavior isn't as rewarded as it was on SO, and there are venues to discuss issues.

Re: What AI did to stackoverflow in a graph

#536

Earlier quoted context omitted.

> StackExchange had ridiculously high barriers to participation, making it inclusive to the long-time users on the site, but exclusive to the newbie participants who found themselves blocked for asking questions. I'm no Jon Skeet, but I've had an account since 2009, I answered a question early on that's had well over 1000 upvotes, which I think is 10k of reputation for that answer alone. Yet I certainly couldn't ask…

Would you be willing to show questions you attempted to ask? I'd be happy to help explain how policy works/worked there.

I love the implication that thousands of people, from a broad spectrum, who all had the same negative experiences with what was obviously a serious endemic problem with the site, all just needed to understand the policy better. That was clearly the issue.

Re: What AI did to stackoverflow in a graph

#538
post #9

SO did that all to themselves when they decided they didn't want a community to form and that only question and answers mattered. The moment something else allowed to have a better way to get your answers, there was no reason to go there, because there was no community. I still don't understand why anyone would go with that whole "no conversation please"

Reddit is on the same track. What I've noticed is that moderators have become increasingly hostile. Reddit's AI moderation, which is designed to remove AI slop, has removed multiple top contributors I used to follow on programming, electronics, bodybuilding, welding, machining, and 3Dprinting subs. And the worst part is that Reddit site admins have no idea about this. I know a guy who reckons he can get any account b…

Do you know if those contributors were able to get their accounts back? I was a heavy contributor in a couple of technological subs, and my account was shadowbanned and then removed with no recourse or way to regain access.

Re: What AI did to stackoverflow in a graph

#539

I am surprised how early the overall downward trend developed. There is no doubt LLMs put a nail in the coffin, but the 5 years from 2017 to 2022 look to have brought a non trivial decline of their own

Often the people curating the questions are also the ones who are answering them.

Their goal (loosely described) was so that if you pulled up the front page of the site, you'd find questions that are interesting to read and answer.

If you, as a professional visiting the site went to it and found the front page with things that were trivially answered by reading the documentation or "how do I draw a triangle with stars?" ( https://stackoverflow.com/q/10932962/ type things) you, as a professional, are less likely to stick around.

In the period, Stack Overflow was reducing the ability for people to curate content and trying to boost "welcoming". https://stackoverflow.blog/2018/04/26/stack-overflow-isnt-ve...

Part of this is that much of the early writing style was intended to mirror technical writing. In reading https://learn.microsoft.com/en-us/powershell/scripting/devel... one doesn't find "Hope that helps" at the end of the page.

It takes a while for a person to understand the norms of writing for a given audience. In the early days, people either came to it with that mindset or were able to be given more attention and guidance as to what the expectations for the site were. When Stack Overflow become extremely popular with college students and people outsourcing their work ( https://news.ycombinator.com/item?id=48960245 ) the ability for the... for lack of a better term "elders" of the site to try to get people to understand how the site worked and its expectations.

Many of the new users expected Stack Overflow to work much like forums - with a back and forth between people and a chat like environment... that wasn't so. The use of the curation tools to try to help onboard a person were deemed as unfriendly and "toxic" started getting tossed around.

Stack Overflow corporate, trying to be sensitive to the broader cultural movements at the time and the "we need to make this a more inclusive space" made it harder to curate and began a campaign of removing or limiting curation tools as part of "welcoming".

During this time, there was one tool that was enhanced in its effectiveness. If you had a gold badge on a tag you could close it as a dup of another question categorically. Rather than "this question is poorly written and it is unclear what you are asking" (requiring 5 close votes from different people - that would never happen if it didn't happen in the first few minutes because few went to the review queues) they could close the question as a duplicate of what it might be.

That didn't help things when it came to the perception of the site. It was a last ditch effort to try to make it so that the front page was the well asked questions.

Combining the reduction of curation tools, labeling their use as gatekeeping, the growing ratio of new users to elders, and corporate quite literally saying that those people who were doing the curation were the bad guys... well, a lot of them left or reduced their activity.

That in turn made it so that it was harder to find the well asked questions and fewer people were around to answer questions. Note I write "well asked" not "valid" - a lot of people claim to have a valid question but don't ask it in a way that is well suited to the Q&A format.

Combine that again with reductions in staff, various awful "experiments" in the name of improving engagement. That was akin to firing half of a construction team at a house while having them add a new patio... all the while the basement is flooded.

And so you've got what is there today. Very few curators left compared to 2016. Few caring answer new difficult questions. The easy college homework questions (how do you draw a triangle) and the outsourcing of work to free labor is now done with an LLM... and there's no coming back from that. ... And few people believe in the mission goal of Stack Overflow - and those who do, don't believe Stack Overflow corporate believes in that mission goal.

Re: What AI did to stackoverflow in a graph

#540

Earlier quoted context omitted.

> Their rules, (I believe unintentionally) give iron-fisted fiefdom rulers a toolbox of justifications to control and alienate under the guise of protecting the quality of the site data. That isn't what happens. I know many, many people believe it to be what happens, but I know from years of seeing the process on the inside that it's absolutely not what happens in the overwhelming majority of cases. The "quality of t…

> That isn't what happens. I know many, many people believe it to be what happens, but I know from years of seeing the process on the inside that it's absolutely not what happens in the overwhelming majority of cases. If quite literally every person I interact with professionally has an anecdote about this happening, your anecdote about it not happening is not very convincing. Have you/SO staff/SO mods considered why…

Many people come to Stack Overflow carrying preconceptions about how the site is supposed to operate and are surprised when reality does not agree with them. Since admitting to being wrong would be too hard, they prefer to come up with quasi-conspiratorial explanations of inflated egos, secret motives and admin cliques. Same thing happens to Wikipedia, really.

"But you said you want to build the sum of all human knowledge! Why can't you accept this piece of alternative history I just made up?"

"So, Stack Overflow is for the computer stuff, right? I have this Word document that... what do you mean this is not a programming question?"

"Since I have no idea where else I could go with this, you must allow me to post it here!"

I mean, it's not like either project is free from power-tripping moderators and overzealous application of procedure; in fact, it's not even particularly rare... but still rarer than the loudest naysayers keep insisting. I have witnessed plenty of dysfunctions myself, and yet whenever I hear others' complaints, I tend to suspect this is yet another case that boils down to "how dare you delete my stuff". With many such anecdotes, I notice they only speak of the situation in the vaguest of terms, omitting details that would have enabled me to identify the actual problem... which I cannot help but wonder if this is because if I were to see the situation myself, it would have made the complainer look much worse.

Post reply on HN