Live data from Hacker News

The Overflow Offline project

stackoverflow.blog

21–30 of 40 posts

Re: The Overflow Offline project

#21
post #14

To me this basically seems like boat programming made respectable. Of course, if you asked me, it always was. You couldn't assume great connectivity then and you often still can't today.

To me this is programming during the first 10 years where the "Internet" were local BBS, magazines spoke about Compuserve and Prodigy, and the connection rates where impossible, so we had to get by with what came on magazines and local library.

Re: The Overflow Offline project

#22
This has been available for a while but it's great to see some acknowledgement especially since the most recent data set was stuck in 2019 for a while.

Here are the datasets: http://download.kiwix.org/zim/stack_exchange/

It's not clear to me why the data set shrank between 2019/3 and 2022/6; was something excluded? Compression improvements?

> stackoverflow.com_en_all_2019-02.zim 2019-03-12 19:53 134G

> stackoverflow.com_en_all_2022-05.zim 2022-06-17 12:36 75G

Re: The Overflow Offline project

#23

Nice to find Kiwix again. Shameless plug, I made my own Kiwix alternative for macOS: https://github.com/technusm1/kiwings

So this is a desktop app, but it uses the server as part of it? The normal Kiwix desktop client doesn't do that right?

I'll throw in my own shameless plug: Self-host your Stack Overflow, Wikipedia etc on Sandstorm: https://apps.sandstorm.io/app/5uh349d0kky2zp5whrh2znahn27gwh... Obviously uses kiwix-serve as well. 3 years old, I need to make a better clip for updating it.

Re: The Overflow Offline project

#24
post #22

This has been available for a while but it's great to see some acknowledgement especially since the most recent data set was stuck in 2019 for a while. Here are the datasets: http://download.kiwix.org/zim/stack_exchange/ It's not clear to me why the data set shrank between 2019/3 and 2022/6; was something excluded? Compression improvements? > stackoverflow.com_en_all_2019-02.zim 2019-03-12 19:53 134G > stackoverflow.…

The data isn't stuck. The data is available here

https://archive.org/details/stackexchange

It's the "official" place to get the data

I've download it several times and extracted my own contributions.

Re: The Overflow Offline project

#26
post #17

I remember already being able to use certain stackexchanges with kiwix before, as well as the arch wiki, wikipedia without images, and some other great resources. It is nice to see that they actually pay attention to this use-case and I look forward to updated workflows with kiwix or similar in the future. Latency is way better that way, even with good and stable internet. OpenZIM[1] is also useful in turning any pag…

What was test score ;)

Re: The Overflow Offline project

#27
post #22

This has been available for a while but it's great to see some acknowledgement especially since the most recent data set was stuck in 2019 for a while. Here are the datasets: http://download.kiwix.org/zim/stack_exchange/ It's not clear to me why the data set shrank between 2019/3 and 2022/6; was something excluded? Compression improvements? > stackoverflow.com_en_all_2019-02.zim 2019-03-12 19:53 134G > stackoverflow.…

The article states:

> ... to ensure that an up-to-date version of our dataset is easily available for those who need it, and will work to improve its readability and reduce its size so there is less friction for end users...

Re: The Overflow Offline project

#28
There was a recent HN Post for codequestion which builds an offline semantic index (using https://github.com/neuml/txtai) on the archive.org Stack Overflow dumps - https://news.ycombinator.com/item?id=33110219

GitHub: https://github.com/neuml/codequestion

Article: https://medium.com/neuml/find-answers-with-codequestion-2-0-...

Re: The Overflow Offline project

#29

They could actually try to build a Copilot competitor off their data. /s

I see the "/s" but I actually do wonder if integrating the "prompt" behavior into the question box would help cut down on the absolutely staggering number of duplicate questions. Regrettably, I'm not enough of a GPT expert to know what percentage of the time it would generate gibberish thus making the duplication question problem _worse_

Re: The Overflow Offline project

#30

They could actually try to build a Copilot competitor off their data. /s

It would be interesting to see how many times a copilot competitor trained off it gave correct code vs wrong code for a given case

I would suspect that would differ whether it was trained on the question's code versus any accepted answer's (or most upvotes?) code
Post reply on HN