Live data from Hacker News

Total monthly number of StackOverflow questions over time

data.stackexchange.com

231–240 of 1001 posts

Re: Total monthly number of StackOverflow questions over time

#231
post #210

Some comments: - This is a really remarkable graph. I just didn't realize how thoroughly it was over for SO. It stuns me as much as when Encyclopædia Britannica stopped selling print versions a mere 9 years after the publication of Wikipedia, but at an even faster timescale. - I disagree with most comments that the brusque moderation is the cause of SO's problems, though it certainly didn't help. SO has had poor mode…

Thinking from first principles, a large part of the content on stack overflow comes from the practical experience and battle scars worn by developers sharing them with others and cross-curating approaches.

Privacy concerns notwithstanding, one could argue having LLMs with us every step of the way - coding agents, debugging, devops tools etc. It will be this shared interlocutor with vast swaths of experiential knowledge collected and redistributed at an even larger scale than SO and forum-style platforms allow for.

It does remove the human touch so it's quite a different dynamic and the amount of data to collect is staggering and challenging from a legal point of view, but I suspect a lot of the knowledge used to train LLMs in the next ten years will come from large-scale telemetry and millions of hours in RL self-play where LLMs learn to scale and debug code from fizzbuzz to facebook and twitter-like distributed system.

Re: Total monthly number of StackOverflow questions over time

#232

I spent the last 14 days chasing an issue with a Spark transform. Gemini and Claude were exceptionally good at giving me answers that looked perfectly reasonable: none of them worked, they were almost always completely off-road. Eventually I tried with something else, and found a question on stackoverflow, luckily with an answer. That was the game changer and eventually I was able to find the right doc in the Spark (…

What I always appreciate about SO is the dialogue between commenters. LLMs give one answer, or bullet points around a theme, or just dump a load of code in your IDE. SO gives a debate, in which the finer points of an issue are thrashed out, with the best answers (by and large) floating to the top. SO, at its best, is numerous highly-experienced and intelligent humans trying to demonstrate how clever they are. A bit l…

SO also isn't afraid to tell you that your question is stupid and you should do it a better way.

Some people take that as a personal attack, but it can be more helpful than a detailed response to the wrong question.

Re: Total monthly number of StackOverflow questions over time

#233
post #210

Some comments: - This is a really remarkable graph. I just didn't realize how thoroughly it was over for SO. It stuns me as much as when Encyclopædia Britannica stopped selling print versions a mere 9 years after the publication of Wikipedia, but at an even faster timescale. - I disagree with most comments that the brusque moderation is the cause of SO's problems, though it certainly didn't help. SO has had poor mode…

I think the interesting thing here for those of us who use open source frameworks is that we can ask the LLM to look at the source to find the answer (eg. Pytorch or Phoenix in my case). For closed source libraries I do not know.

Re: Total monthly number of StackOverflow questions over time

#234

I once published a method for finding the closest distance between an ellipse and a point on SO: https://stackoverflow.com/questions/22959698/distance-from-g... I consider it the most beautiful piece of code I've ever written and perhaps my one minor contribution to human knowledge. It uses a method I invented, is just a few lines, and converges in very few iterations. People used to reach out to me all the time with…

You should write it up and submit it to some journal officially. Doesn't matter if it mostly duplicates your own (technically unpublished) work.

Re: Total monthly number of StackOverflow questions over time

#235

I spent the last 14 days chasing an issue with a Spark transform. Gemini and Claude were exceptionally good at giving me answers that looked perfectly reasonable: none of them worked, they were almost always completely off-road. Eventually I tried with something else, and found a question on stackoverflow, luckily with an answer. That was the game changer and eventually I was able to find the right doc in the Spark (…

What I always appreciate about SO is the dialogue between commenters. LLMs give one answer, or bullet points around a theme, or just dump a load of code in your IDE. SO gives a debate, in which the finer points of an issue are thrashed out, with the best answers (by and large) floating to the top. SO, at its best, is numerous highly-experienced and intelligent humans trying to demonstrate how clever they are. A bit l…

> I don't think this is something that LLMs can ever replicate. They don't have the egos and they certainly don't have the experience

Interesting question - the result is just words so surely a LLM can simulate an ego. Feed it the Linux kernel mailing list?

Isn’t back and forth exactly what the new MoE thinking models attempt to simulate?

And if they don’t have the experience that is just a question of tokens?

Re: Total monthly number of StackOverflow questions over time

#236
post #210

Some comments: - This is a really remarkable graph. I just didn't realize how thoroughly it was over for SO. It stuns me as much as when Encyclopædia Britannica stopped selling print versions a mere 9 years after the publication of Wikipedia, but at an even faster timescale. - I disagree with most comments that the brusque moderation is the cause of SO's problems, though it certainly didn't help. SO has had poor mode…

> I wonder if, 10 years from now, LLMs will still be answering questions that were answered in the halcyon 2014-2020 days of SO better than anything that came after? I've wondered this too and I wonder if the existing corpus plus new GitHub/doc site scrapes will be enough to keep things current.

Widespread internet adoption created “eternal September”, widespread LLM deployment will create “eternal 2018”

Re: Total monthly number of StackOverflow questions over time

#237
I used to contribute a ton to Stack Overflow at the beginning in 2009 and 2010 and then stopped cold turkey. One of the senior product execs emailed me to see what turned me off.

What killed it for me was community moderation. People who cannot contribute with quality content will attempt to contribute by improperly and excessively applying their opinion of what is allowed.

Unfortunately it happens to every online technical community once they become popular enough. I even see it happening on HN.

Re: Total monthly number of StackOverflow questions over time

#238

I once published a method for finding the closest distance between an ellipse and a point on SO: https://stackoverflow.com/questions/22959698/distance-from-g... I consider it the most beautiful piece of code I've ever written and perhaps my one minor contribution to human knowledge. It uses a method I invented, is just a few lines, and converges in very few iterations. People used to reach out to me all the time with…

You can write a paper, submit the arxiv, and you can also make a blog post. At any rate, I agree - SO was (is?) a wonderful place for this kind of thing.

I once had a professor mention that they knew me from SO because I posted a few underhanded tricks to prevent an EKF from "going singular" in production. That kind of community is going to be hard to replace, but SO isnt going anywhere, you can still ask a question and answer your own question for permanent, searchable archive.

Re: Total monthly number of StackOverflow questions over time

#239
post #177

Earlier quoted context omitted.

well you can say all that but it doesn't hold up to experience. The culture feels very different here. So, no, it's not the same.

[flagged]

For someone with a green username, you sure do have strong opinions about hn

Re: Total monthly number of StackOverflow questions over time

#240
post #55

For me, my usage of SO started declining as LLMs rose. Occasionally I still end up there, usually because a chat response referenced a SO thread. I was willing to put up with the toxicity as long as the site still had technical value for me. But still, machines leave me wanting. Where do people go to ask real humans novel technical questions these days?

Find the relevant discord and search.
Post reply on HN