Live data from Hacker News

Newsgroups and the Internet Archive: I Made a Difference

screengod.blogspot.com

41–50 of 65 posts

Re: Newsgroups and the Internet Archive: I Made a Difference

#41
post #11

It's great to see some Usenet archives out there to partly make up for the disappointment of Google Groups. But I'm sad that this archive seems to be incomplete, even within its stated date range. Back in the day, I was active on rec.arts.books.tolkien and alt.fan.tolkien: in this archive, I can't find any trace of the massive "alt." hierarchy at all, and the list of files for the "rec." hierarchy doesn't include the…

It's my fault (not the IA), I thought I'd got all newsgroups but must have missed some. I just checked the main newsgroup list and it's incomplete, for some reason. My plan though, is to dust off the old code, get a complete list of groups, get them, and then make it searchable. Sorry about that, I didn't check. This was all done in 2013. Basically, I wanted to build a search engine but indexing the newsgroup posts (…

No apologies necessary: creating the archive in the first place was awesome! Like I said, this just shows how massive and complex Usenet is (or maybe, was), and how it's not easy at all to create a comprehensive archive. It's far better to have some of it than none of it!

Re: Newsgroups and the Internet Archive: I Made a Difference

#42
post #15
post #11

It's great to see some Usenet archives out there to partly make up for the disappointment of Google Groups. But I'm sad that this archive seems to be incomplete, even within its stated date range. Back in the day, I was active on rec.arts.books.tolkien and alt.fan.tolkien: in this archive, I can't find any trace of the massive "alt." hierarchy at all, and the list of files for the "rec." hierarchy doesn't include the…

It looks like the downloads are grouped by top level group. So you can go to https://archive.org/download/gna-rec and see all archived groups that are in the rec hierarchy.

Right: As I said earlier, the list in this archive includes rec.humor.funny but not rec.arts.books.tolkien. (And I seem to recall that the alt.* hierarchy was a little less broadly propagated, which might possibly be related to why it wasn't included here.)

Re: Newsgroups and the Internet Archive: I Made a Difference

#43
post #38
post #35

Earlier quoted context omitted.

... gone to Sweden on vacation. More seriously, I think a better analogy is putting a frog in cold water and turning on the stove's burner. Things are much worse but because it happened so slowly, we simply have a "new normal". The change from one day to the next on this time-scale is undiscernable.

If you put a frog in cold water and gradually heat the water, the frog will jump out ( https://en.wikipedia.org/wiki/Boiling_frog ). The premise of that analogy is widely considered to be completely false.

Hmm ... that completely makes sense when they reminded me that amphibians have to regulate their temperatures via ambient conditions. Unfortunately it also completely ruins my analogy (though not my point).

Perhaps the analogy should be a free citizen of a democratic society gradually allows corporations to (after being deemed a living entity) slowly distribute all wealth creation to the plutocrats as they go from being solid middle class to a virtual slave in another corporation's giant warehouses.

Re: Newsgroups and the Internet Archive: I Made a Difference

#44

I miss dejanews - anyone remember that before Google bought them? They had full search, it's a shame Google let that go. Their search went back to pretty much the beginning of net news. Does that exist anywhere anymore?

I remember dejanews, but don't remember liking the experience. I remember being very excited when Google acquired them.

I remember being super bummed when bitrot set in. Posts I knew existed just couldn't be found.

As someone who got their first car running by way of Usenet archives (a 69 Beetle), I always loved how well it was archived compared to all the web bulletin boards that fragment so much information as they quickly rot year after year.

Re: Newsgroups and the Internet Archive: I Made a Difference

#45
post #5
post #3

It's pretty sad that a bunch of people sent historical Usenet archives to Google, they imported them into Google Groups, and then... basically hid/lost access to it over time. I assume the data is in GFS somewhere but it may never see the light of day. But maybe we just need to shame them every decade: https://www.wired.com/2009/10/usenet/

Google Groups was great when they first acquired all those archives! It just got progressively worse and worse over time, and I've never understood why. (Stagnation I could understand, but how did the same searches get less effective?)

Google has a continual Red Queen's race between everyone's dependencies. I'm guessing they were lucky to keep it mostly working and avoid Reader's fate.

"We're deprecating X, please migrate to Y by this date."

"Y doesn't support all our use cases!"

"Neither will X when we turn it off, sorry."

Re: Newsgroups and the Internet Archive: I Made a Difference

#46

Google's Usenet archive is too important to be owned by one company. My understanding is some Google engineers worked a few years ago to make sure Archive had a copy, but I can't verify that and I don't think it's online. Some of the earliest archives come from Eugene Spafford's collection which is readily online elsewhere, but Google did a lot of work cleaning it and of course has the DejaNews archives which are inv…

[deleted]

Re: Newsgroups and the Internet Archive: I Made a Difference

#47
post #8

Earlier quoted context omitted.

Google search in general has become less effective, so perhaps it simply carried over.

Search is abysmal these days. I'll look for a term with 3 words and it almost always throws out one word, giving me useless results.

Quotes still force the word to be included don't they? Though I suppose that still doesn't do much if the algorithm has tossed out the matches you want.

Re: Newsgroups and the Internet Archive: I Made a Difference

#48
post #16

Earlier quoted context omitted.

Search is abysmal these days. I'll look for a term with 3 words and it almost always throws out one word, giving me useless results.

”You searched for Stockholm Syndrome Research. Here’s a bunch of Stockholm travel blogs! They’re just missing two of your keywords, but they’re really popular with other visitors”

I just did this search, and at least the first page only had results perfectly matching the query.

Try yourself: https://www.google.com/search?q=Stockholm+Syndrome+Research

Re: Newsgroups and the Internet Archive: I Made a Difference

#49
For all of you who are misty-eyed pondering those wonderful, probably-lost-forever Usenet posts from the 90s, I dare you to read Kibo's .signature (last updated 5/5/94 4:52AM http://archive.birdhouse.org/etc/kibosig.txt to cure yourselves of misplaced misty-eyed nostalgia for those long-ago times when the Internet was something else.

Kibo for President!

Re: Newsgroups and the Internet Archive: I Made a Difference

#50
post #16

Earlier quoted context omitted.

”You searched for Stockholm Syndrome Research. Here’s a bunch of Stockholm travel blogs! They’re just missing two of your keywords, but they’re really popular with other visitors”

I just did this search, and at least the first page only had results perfectly matching the query. Try yourself: https://www.google.com/search?q=Stockholm+Syndrome+Research

Same for me.

But then, no Google account or cookies for me, so ...

Post reply on HN