Earlier quoted context omitted.
>For all their flaws, LLMs are so much better But LLMs get their answers from StackOverflow and similar places being used as the source material. As those start getting outdated because of lack of activity, LLMs won't have the source material to answer questions properly.
StackOverflow answers are outdated. Every time I end up on that site these days, I find myself reading answers from 12 years ago that are no longer relevant.
Total monthly number of StackOverflow questions over time
531–540 of 1001 posts
Re: Total monthly number of StackOverflow questions over time
#532Some comments: - This is a really remarkable graph. I just didn't realize how thoroughly it was over for SO. It stuns me as much as when Encyclopædia Britannica stopped selling print versions a mere 9 years after the publication of Wikipedia, but at an even faster timescale. - I disagree with most comments that the brusque moderation is the cause of SO's problems, though it certainly didn't help. SO has had poor mode…
Questions asked on SO that got downvoted by the heavy handed moderation would have been answered by LLMs without any of the flak whatsoever.
Those who had downvoted other's questions on SO for not being good enough, must be asking a lot of such not good enough questions to an LLM today.
Sure, the SO system worked, but it was user hostile and I'm glad we all don't have to deal with it anymore.
Re: Total monthly number of StackOverflow questions over time
#533Some comments: - This is a really remarkable graph. I just didn't realize how thoroughly it was over for SO. It stuns me as much as when Encyclopædia Britannica stopped selling print versions a mere 9 years after the publication of Wikipedia, but at an even faster timescale. - I disagree with most comments that the brusque moderation is the cause of SO's problems, though it certainly didn't help. SO has had poor mode…
> The fundamental value proposition of SO is getting an answer to a question I read an interview once with one of the founders of SO. They said the main value stackoverflow provided wasn't to the person who asked the question. It was for the person who googled it later and found the answer. This is why all the moderation pushes toward deleting duplicates of questions, and having a single accepted answer. They were pr…
I'd say 9/10 times I find a direct match for my question on SO it's been closed as offtopic with links to one or more questions that are only superficially similar.
There are other problems that they don't even try to address. If 10 people ask the same question, why does only the first person to ask it get to choose the answer? Then lots of "XY" questions where the original asker didn't actually have problem X so selects an answer for Y, leaving the original X unsolved, and now all the duplicates only have an answer for Y too.
Re: Total monthly number of StackOverflow questions over time
#534Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.
Re: Total monthly number of StackOverflow questions over time
#535Earlier quoted context omitted.
Thinking from first principles, a large part of the content on stack overflow comes from the practical experience and battle scars worn by developers sharing them with others and cross-curating approaches. Privacy concerns notwithstanding, one could argue having LLMs with us every step of the way - coding agents, debugging, devops tools etc. It will be this shared interlocutor with vast swaths of experiential knowled…
Am I the only one that sees this as a hellscape? No longer interacting with your peers but an LLM instead? The knowledge centralized via telemetry and spying on every user’s every interaction and only available thru a enshitified subscription to a model that’s been trained on this stolen data?
Well, turns out developers are now the product too. Good job everyone.
Re: Total monthly number of StackOverflow questions over time
#536I once published a method for finding the closest distance between an ellipse and a point on SO: https://stackoverflow.com/questions/22959698/distance-from-g... I consider it the most beautiful piece of code I've ever written and perhaps my one minor contribution to human knowledge. It uses a method I invented, is just a few lines, and converges in very few iterations. People used to reach out to me all the time with…
Has the added benefit of NOT returning stackoverflow answers, since StackOverflow seems to have rotted out these days, and been taken over by the "rejection police".
Re: Total monthly number of StackOverflow questions over time
#537Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.
They are closed for good reasons. People just have their own ideas about what the reasons should be. Those reasons make sense according to others' ideas about what they'd like Stack Overflow to be, but they are completely wrong for the site's actual goals and purposes. The close reasons are well documented (https://meta.stackoverflow.com/questions/417476) and well considered, having been exhaustively discussed over many years.
> or being labeled a duplicate even though they often weren’t
I have seen so many people complain about this. It is vanishingly rare that I actually agree with them. In the large majority of cases it is comically obvious to me that the closure was correct. For example, there have been many complaints in the Python tag that were on the level of "why did you close my question as a duplicate of how to do X with a list? I clearly asked how to do it with a tuple!" (for values of X where you do it the same way.)
> a generally toxic and condescending culture amongst the top answerers.
On the contrary, the top answerers are the ones who will be happy to copy and paste answers to your question and ignore site policy, to the constant vexation of curators like myself trying to keep the site clean and useful (as a searchable resource) for everyone.
> For all their flaws, LLMs are so much better.
I actually completely agree that people who prefer to ask LLMs should ask LLMs. The experience of directly asking (an LLM) and getting personalized help is explicitly the exact thing that Stack Overflow was created to get away from (i.e., the traditional discussion forum experience, where experts eventually get tired of seeing the same common issues all the time and all the same failures to describe a problem clearly, and where third parties struggle to find a useful answer in the middle of along discussion).
Re: Total monthly number of StackOverflow questions over time
#538Earlier quoted context omitted.
You can (and always were encouraged to) ask your own questions, too. And there are more sites like this (see e.g. https://codidact.com — fd: moderator of the Software section). Just because something loses popularity isn't a reason to stop doing it.
StackOverflow is famously obnoxious about questions badly asked, badly categorized, duplicated… It’s actually a topic on which StackOverflow would benefit from AI A LOT. Imagine StackOverflow rebrands itself as the place where you can ask the LLM and it benefits the world, whoch correctly rephrasing the question behind the scenes and creating public records for them.
Re: Total monthly number of StackOverflow questions over time
#539Earlier quoted context omitted.
No, that is completely wrong. It is exactly because the questions are not identical that the system works. That is what allows for multiple versions of a popular, important question to catch attention from search engines, and send everyone to the same, correct place. Perhaps your objection is that, because the target question is not literally identical (for example, maybe a code sample has different variable names, o…
You are positing that only questions with cosmetic or extraneous differences are marked as duplicates. That's not the case. As a maintainer of a popular project who has engaged with thousands of Qs on SO related to that project, I've seen many Qs marked as duplicate where the actual answer would be different in a non-trivial manner. When I look at who all moderated on those Qs, they are usually users who haven't cont…
Yes, it is. I have been active on both the main and meta sites for many years. I have seen so many of these complaints and they overwhelmingly boil down to that. And I have gotten so unbelievably stressed out on so many occasions trying to explain to people why their trivial objections are missing the point of the site completely.
> I've seen many Qs marked as duplicate where the actual answer would be different in a non-trivial manner.
Please feel free to cite specific examples. I'll be happy to explain policy.
> When I look at who all moderated on those Qs, they are usually users who haven't contributed to that topic at SO.
That is generally irrelevant.
Re: Total monthly number of StackOverflow questions over time
#540Earlier quoted context omitted.
Oh I love that game! (At least I think it's a game) You ask how to do X. Member M asks why you want to do X. Because you want to do Y. Well!? why do you want to do Y?? Because Y is on T and you can't do K so you need a Z Well! Well! Why do you even use Z?? Clearly J is the way it is now recommended! Because Z doesn't work on a FIPS environment. ... Can you help me? ... I just spent 15 minutes explaining X, Y and Z. D…
To be fair, asking why someone wants to do something is often a good question. Especially in places like StackOverflow where the people asking questions are often inexperienced. I see it all the time professionally too. People ask "how do I do X" and I tell them. Then later on I find out that the reason they're asking is because they went down a whole rabbit hole they didn't need to go down. An analogy I like is imag…
I don't think your analogy really helps here, it's not a question. If the question was "How do I get to the top of the mountain" or "How do I want to get to the top of the mountain without hiking" the answer to both would be "Gondola".