Live data from Hacker News

Total monthly number of StackOverflow questions over time

data.stackexchange.com

61–70 of 1001 posts

Re: Total monthly number of StackOverflow questions over time

#61
post #13

Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.

How can we be sure that LLMs won't start giving stale answers?

Re: Total monthly number of StackOverflow questions over time

#63
post #38
post #13

Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.

Long before LLMs. Setting aside peak-COVID as a weird aberration, question volume has been in decline since 2014 or maybe 2016.

Stack Overflow would still have a vibrant community if it weren't for the toxic community.

Imagine a non-toxic Stack Overflow replacement that operated as an LLM + Wiki (CC-licensed) with a community to curate it. That seems like the sublime optimal solution that combines both AI and expertise. Use LLMs to get public-facing answers, and the community can fix things up.

No over-moderation for "duplicates" or other SO heavy-handed moderation memes.

Someone could ask a question, an LLM could take a first stab at an answer. The author could correct it or ask further questions, and then the community could fill in when it goes off the rails or can't answer.

You would be able to see which questions were too long-tail or difficult for the AI to answer, and humans could jump in to patch things up. This could be gamified with points.

This would serve as fantastic LLM training material for local LLMs. The authors of the site could put in a clause saying that "training is allowed as long as you publish your weights + model".

Someone please build this.

Edit: Removed "LLMs did not kill Stack Overflow." first sentence as suggested. Perhaps that wasn't entirely accurate, and the rest of the argument stands better on its own legs.

Re: Total monthly number of StackOverflow questions over time

#64
Good riddance to bad rubbish (TLDR: Questions are now almost never being asked on Stack overflow).

The most annoying example I can think of (but can’t link to, alas) is when I Googled for an answer to a technical question, and got an annoying Stack Overflow answer which didn’t answer the question, telling the person to just Google the answer.

Re: Total monthly number of StackOverflow questions over time

#65
post #46
post #13

Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.

It seemed to me that pre-llm, google had stopped surfacing stackoverflow answers in search results.

My memory is there were a spate of SO scraping sites that google would surface above SO and google just would not zap.

It would have been super trivial to fix but google didn’t.

My pet theory was that google were getting doubleclick revenue from the scrapers so had incentives to let them scrape and to promote them in search results.

Re: Total monthly number of StackOverflow questions over time

#67
post #13

Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.

> For all their flaws, LLMs are so much better. For now. They still need to be enshitted.

Models are check-pointed. You can save one you like and use it forever.

Re: Total monthly number of StackOverflow questions over time

#68

Many users left because they had had overly strict moderation for posting your questions. I have 6k reputation, multiple gold badges and I will remember StackOverflow as a hostile place to ask a questions, honestly. There were multiple occasions when they actually prevented me from asking, and it was hard to understand what exactly went wrong. To my understanding, I asked totally legit questions, but their asking pol…

It's also was a bit frustrating for me to answer. There was time when I wanted to contribute, but questions that I could answer were very primitive and there were so many people eager to post their answer that it demotivated me and I quickly stopped doing that. Honestly there are too many users and most of them know enough to answer these questions. So participating as "answerer" wasn't fun for me.

Re: Total monthly number of StackOverflow questions over time

#69
post #13

Not a big surprise once LLMs came along: stack overflow developed some pretty unpleasant traits over time. Everything from legitimate questions being closed for no good reason (or being labeled a duplicate even though they often weren’t), out of date answers that never get updated as tech changes, to a generally toxic and condescending culture amongst the top answerers. For all their flaws, LLMs are so much better.

The irony is that the LLMs are trained on stack overflow and should inherit a lot of those traits and errors.
Post reply on HN