Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.
Total monthly number of StackOverflow questions over time
61–70 of 1001 posts
Re: Total monthly number of StackOverflow questions over time
#62Seems like the exit was very well timed. https://meta.stackoverflow.com/questions/408138/what-will-ha...
Re: Total monthly number of StackOverflow questions over time
#63Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.
Long before LLMs. Setting aside peak-COVID as a weird aberration, question volume has been in decline since 2014 or maybe 2016.
Imagine a non-toxic Stack Overflow replacement that operated as an LLM + Wiki (CC-licensed) with a community to curate it. That seems like the sublime optimal solution that combines both AI and expertise. Use LLMs to get public-facing answers, and the community can fix things up.
No over-moderation for "duplicates" or other SO heavy-handed moderation memes.
Someone could ask a question, an LLM could take a first stab at an answer. The author could correct it or ask further questions, and then the community could fill in when it goes off the rails or can't answer.
You would be able to see which questions were too long-tail or difficult for the AI to answer, and humans could jump in to patch things up. This could be gamified with points.
This would serve as fantastic LLM training material for local LLMs. The authors of the site could put in a clause saying that "training is allowed as long as you publish your weights + model".
Someone please build this.
Edit: Removed "LLMs did not kill Stack Overflow." first sentence as suggested. Perhaps that wasn't entirely accurate, and the rest of the argument stands better on its own legs.
Re: Total monthly number of StackOverflow questions over time
#64The most annoying example I can think of (but can’t link to, alas) is when I Googled for an answer to a technical question, and got an annoying Stack Overflow answer which didn’t answer the question, telling the person to just Google the answer.
Re: Total monthly number of StackOverflow questions over time
#65Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.
It seemed to me that pre-llm, google had stopped surfacing stackoverflow answers in search results.
It would have been super trivial to fix but google didn’t.
My pet theory was that google were getting doubleclick revenue from the scrapers so had incentives to let them scrape and to promote them in search results.
Re: Total monthly number of StackOverflow questions over time
#66Re: Total monthly number of StackOverflow questions over time
#67Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.
> For all their flaws, LLMs are so much better. For now. They still need to be enshitted.
Re: Total monthly number of StackOverflow questions over time
#68Many users left because they had had overly strict moderation for posting your questions. I have 6k reputation, multiple gold badges and I will remember StackOverflow as a hostile place to ask a questions, honestly. There were multiple occasions when they actually prevented me from asking, and it was hard to understand what exactly went wrong. To my understanding, I asked totally legit questions, but their asking pol…
Re: Total monthly number of StackOverflow questions over time
#69Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.