What AI did to stackoverflow in a graph

I'm criticizing the design of the site (and to some extent the rules that were set up) more so than the moderators trying to operate within it. I'm aware of how thankless a job moderating can be, and how a Q&A site can quickly die under a mass of help vampires who will just suck up endless effort if you let them. I think a lot of the site's design really played into it, and realistically it was probably something that needed to evolve as it grew and matured, because the dynamics really change at different stages.

> the explicit purpose and sole effect of closing a question is to prevent answers unless and until it is fixed

This is a decision I would question. What is it about a bad question that makes answers undesirable until the question itself is fixed? Especially when the judgement of such badness might be faulty (even if it's encouraged to bias towards leaving it open). Again, the answer may be the moderators doing the best with the tools their given (e.g. lacking good ways to otherwise surface the better questions to potential answers), but this is exactly the kind of issue I think tends to underlie SO's problems.

> The way that people talk about "toxicity" on Stack Overflow comes across like they think it was constantly full of insults and slurs

I don't get that impression. The perceived toxicity comes from a somewhat inscrutable set of rules and also apparently inconsistent enforcement which created a lot of frustration with the site. None of this requires that the moderation is even impolite. In fact, people can get more frustrated when a result they consider wildly unreasonable is delivered with a cordial tone. The trope of a saccharine sweet but utterly evil bureaucrat exists for a reason, and I think that is the kind of impression people who describe SO as toxic are describing, whatever the underlying cause (which is almost certainly not that a bunch of people spending their spare time moderating a site are just evil for the sake of it).

(And it's not unique to SO. Wikipedia has a lot of the same problems, though with different causes and attempts to solve them)

> I'm criticizing the design of the site (and to some extent the rules that were set up)

So we agree (but the people you're talking about are not moderators). Again:

>Everyone involved would have loved to "explain this to people gently". There was no space provided in which to do it.

Onward:

> What is it about a bad question that makes answers undesirable until the question itself is fixed?

Many things.

It was partly about working around other missteps of the system design: closed questions that aren't fixed are supposed to get deleted, but the system automating this was deliberately conservative, and in particular would preserve anything that had an answer.

The more bad questions there are, the greater the chance that a third party trying to find a good question with a search engine will find a bad question instead. Sometimes that can be fixed with duplicate linking, but often not.

When a curator believes that a question is a duplicate, and is trying to find the "canonical" version with the best questions and answers, the more bad questions there are, the greater the chance that the curator fails to find that question. This is because bad questions carry a risk of resembling the desired target while actually being about something else.

Answers written for a bad question might be worse because they misunderstand the situation due to the quality issue; and they might be invalidated when the question gets fixed.

Answering bad, low-effort questions contributes to the incorrect impression that effort isn't expected (because the OP gets a reward that might be seen as far more valuable than abstract reputation points: personalized, possibly-working code). It incentivizes more bad questions, when the goal is to preempt bad questions and get people to understand question quality.

Finally, of course, answering bad questions wastes time and effort that could have been spent on better questions.

See also: https://meta.stackoverflow.com/questions/429808

> In fact, people can get more frustrated when a result they consider wildly unreasonable is delivered with a cordial tone.

Right. And the site owners would insist that we adopt that cordial tone, and made multiple attempts to shift the Code of Conduct around in a way that they hoped would lead to more cordial tone.

And people reacting badly to commentary, even when given in a cordial tone, led to people not trying to explain their actions at all. Which led to people being upset that actions were taken without explanation (including in a significant fraction of cases where the system's automatic explanation was perfectly clear enough, frankly).

Seriously: there were many people who came to the meta site after asking a question that literally started with words to the effect of "What do you think is the best...", and then presented as if they could not possibly understand why the question was deemed "opinion-based".

Semantics

The peak was in 2014, far before any coherent AI became a thing.

As someone with substantial "points" accumulated all a full decade ago, I can easily see why. If you only allow certain opinions and criteria for specific subjects, your user will eventually shrink to only the few that possessed them.

It's a Spartan death. Don't blame it on the Persians or Athens.

I relate to sfn42. That *is* the stack overflow experience. That is the average programming forum experience when you frequent it for more than just to get your problems solved.