Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.
It doesn't have anything to do with LLMs. It has to do with shifting one's focus from doing good things to making money. Joel did that, and SO failed because of it. Joel promised the answering community he wouldn't sell SO out from under them, but then he did. And so the toxicity at the top trickled down into the community. Those with integrity left the community and only toxic, selfcentered people remained to destro…
Total monthly number of StackOverflow questions over time
201–210 of 1001 posts
Re: Total monthly number of StackOverflow questions over time
#202Are we in the age of all CS problems being solved and everything being invented? Even if so, do LLM incorporate all that knowledge? A lot of my knowledge in CS come from books and lectures, LLMs can shine in that area by scraping all those sources. However SO was less about academic knowledge but more about experience sharing. You won't find recipes for complex problems in books, e.g. how to catch what part of my pro…
Re: Total monthly number of StackOverflow questions over time
#203Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.
How can we be sure that LLMs won't start giving stale answers?
Re: Total monthly number of StackOverflow questions over time
#204Re: Total monthly number of StackOverflow questions over time
#205Re: Total monthly number of StackOverflow questions over time
#206Many users left because they had had overly strict moderation for posting your questions. I have 6k reputation, multiple gold badges and I will remember StackOverflow as a hostile place to ask a questions, honestly. There were multiple occasions when they actually prevented me from asking, and it was hard to understand what exactly went wrong. To my understanding, I asked totally legit questions, but their asking pol…
It's also was a bit frustrating for me to answer. There was time when I wanted to contribute, but questions that I could answer were very primitive and there were so many people eager to post their answer that it demotivated me and I quickly stopped doing that. Honestly there are too many users and most of them know enough to answer these questions. So participating as "answerer" wasn't fun for me.
I remember one infamous user who would farm points by running your questions against some grammar / formatting script. He would make sure to clean up an errant comma or a lingering space character at the end of your post to get credit for editing your question, thereby “contributing.”
To their early credit, I once ran for and nearly won a moderator slot. They sent a nice swag package to thank me for my contributions to the community.
Re: Total monthly number of StackOverflow questions over time
#207Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.
I suppose all sites that have a voting component run the risk of becoming unpleasant. Hacker News, and we who frequent it, ought to have that in mind.
Re: Total monthly number of StackOverflow questions over time
#208Earlier quoted context omitted.
Agreed. I personally stopped contributing to StackOverflow before LLMs, because of the toxic moderation. Now with LLMs, I can't remember the last time I visited StackOverflow.
People in this thread are missing another key component in the decline of StackOverflow - the more experienced you become, the less useful it is. The harder the problem, the less engagement it gets. People who spend hours working on your issue are rewarded with a single upvote. Meanwhile, "how do I concat a string" gets dozens or hundreds of upvotes. The incentive/reward structure punished experienced folks with chal…
Re: Total monthly number of StackOverflow questions over time
#209Earlier quoted context omitted.
Agreed. I personally stopped contributing to StackOverflow before LLMs, because of the toxic moderation. Now with LLMs, I can't remember the last time I visited StackOverflow.
People in this thread are missing another key component in the decline of StackOverflow - the more experienced you become, the less useful it is. The harder the problem, the less engagement it gets. People who spend hours working on your issue are rewarded with a single upvote. Meanwhile, "how do I concat a string" gets dozens or hundreds of upvotes. The incentive/reward structure punished experienced folks with chal…
Re: Total monthly number of StackOverflow questions over time
#210- This is a really remarkable graph. I just didn't realize how thoroughly it was over for SO. It stuns me as much as when Encyclopædia Britannica stopped selling print versions a mere 9 years after the publication of Wikipedia, but at an even faster timescale.
- I disagree with most comments that the brusque moderation is the cause of SO's problems, though it certainly didn't help. SO has had poor moderation from the beginning. The fundamental value proposition of SO is getting an answer to a question; if you can the same answer faster, you don't need SO. I suspect that the gradual decline, beginning around 2016, is due to growth in a number of other sources of answers. Reddit is kind of a dark horse here, as I began seeing answers on Google to more modern technical questions link to a Reddit thread frequently along with SO from 2016 onwards. I also suspect Discord played a part, though this is harder to gauge; I certainly got a number of answers to questions for, e.g., Bun, by asking around in the Bun Discord, etc. The final nail in the coffin is of course LLMs, which can offer a SO-level answer to a decent percentage of questions instantly. (The fact that the LLM doesn't insult you is just the cherry on top.)
- I know I'm beating a dead horse here, but what happens now? Despite stratification I mentioned above, SO was by far the leading source of high quality answers to technical questions. What do LLMs train off of now? I wonder if, 10 years from now, LLMs will still be answering questions that were answered in the halcyon 2014-2020 days of SO better than anything that came after? Or will we find new, better ways to find answers to technical questions?