Live data from Hacker News

Total monthly number of StackOverflow questions over time

data.stackexchange.com

31–40 of 1001 posts

Re: Total monthly number of StackOverflow questions over time

#31

There are still airgapped places in the world where transferring information to offsite LLMs is expressly forbidden, but the offline LLMs available perform so terribly that they’re not worth using. An SO type application can be immensely helpful for engineering teams working in these environments.

But surely transmitting information to actual SO is just as forbidden?

And if you're making an internal-only site, it doesn't really need to be name-brand SO.

Re: Total monthly number of StackOverflow questions over time

#32
post #13

Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.

Agreed. I personally stopped contributing to StackOverflow before LLMs, because of the toxic moderation.

Now with LLMs, I can't remember the last time I visited StackOverflow.

Re: Total monthly number of StackOverflow questions over time

#33
I mean, I kinda of miss it. But man it was a hostile place for newcomers.

Only ever asked one question and I tried to answer more than a handful but never really clicked with the site.

I do wonder if it would have faired better under the original ownership before it was sold in 2021-06-02.

Re: Total monthly number of StackOverflow questions over time

#35

They will no doubt blame this on AI, somehow (ChatGPT release: late 2022, decline start: mid 2020), instead of the toxicity of the community and the site's goals of being a knowledgebase instead of a QA site despite the design. PS - This comment is closed as a [duplicate] of this comment: https://news.ycombinator.com/item?id=46482620

Right. I often end up on Stack Exchange when researching various engineering-related topics, and I'm always blown away by how incredibly toxic the threads are. We get small glimpses of that on HN, but it was absolutely out of control on Stack Exchange.

At the same time, I think there was another factor: at some point, the corpus of answered questions has grown to a point where you no longer needed to ask, because by default, Google would get you to the answer page. LLMs were just a cherry on top.

Re: Total monthly number of StackOverflow questions over time

#36
I do use Claude a lot, but I still regularly ask questions on https://bioinformatics.stackexchange.com/. It's often just too niche, LLMs hallucinate stuff like an entire non-existent benchmarking feature in Snakemake, or can't explain how I should get transcriptome aligners to give me correct quantifications for a transcript. I guess it's too niche. And as a lonely Bioinformatician it can be nice to get confirmation from other bioinformaticians.

Looking back at my Stack Exchange/Stack Overflow (never really got the difference) history, my earlier, more general programming questions from when I just started are all no-brainers for any LLM.

Re: Total monthly number of StackOverflow questions over time

#38
post #13

Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.

Long before LLMs. Setting aside peak-COVID as a weird aberration, question volume has been in decline since 2014 or maybe 2016.

Re: Total monthly number of StackOverflow questions over time

#39
post #13

Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.

Indeed. StackOverflow was by far the most unpleasant website that I have regularly interacted with. Sometimes, just seeing how users were treated there (even in Q&A threads that I wasn’t involved in at all) disturbed me so much it was actually interfering with my work. I’m so, so glad that I can now just ask an AI to get the same (or better) answers, without having to wade through the barely restrained hate on that site.

Re: Total monthly number of StackOverflow questions over time

#40
post #16

Now that StackOverflow has been killed (in part) by LLMs, how will we train future models? Will public GitHub repos be enough? Precise troubleshooting data is getting rare, GitHub issues are the last place where it lives nowadays.

They would just use documentation. I know there is some synthesis they would lose in the training process but I’m often sending Claude through the context7 MCP to learn documentation for packages that didn’t exist, and it nearly always solves the problem for me.

The brilliance of StackOverflow was in being the place to find out how to do tricky workarounds for functionality that either wasn't documented or was buggy such that workarounds were needed to make it actually work.

Software quality is now generally a bit better than it was in 2010, but that need is ultimately still there.

Post reply on HN