Live data from Hacker News

Farewell

byuu.org

71–75 of 75 posts

Re: Farewell

#71

I'll believe byuu cares about preserving history when he's stopped blocking the Wayback Machine from archiving his site. Edit: The good work someone has done is no excuse for anything. > The problem is that the internet is not like any other time in human history: everything we ever say and do gets recorded and indexed, all readily available to anyone curious, for all of time. This is new, and it's something that soc…

Hello,

I removed the archive.is check, and requested the entire site to be crawled, which is now done. The entire site is mirrored here: http://archive.is/byuu.org

I also sent an e-mail to the archive.org staff requesting the exclusion to be removed.

I hope this will satisfy your request, and that you can sympathize with why I chose not to do this until retiring.

Re: Farewell

#72
post #27

I'll believe byuu cares about preserving history when he's stopped blocking the Wayback Machine from archiving his site. Edit: The good work someone has done is no excuse for anything. > The problem is that the internet is not like any other time in human history: everything we ever say and do gets recorded and indexed, all readily available to anyone curious, for all of time. This is new, and it's something that soc…

Same. It seems he's also blocking other archiver tools by showing "Please click the button below to enter byuu.org: [I am not a robot button]": https://archive.vn/NYreE

[deleted]

Re: Farewell

#74
post #71

I'll believe byuu cares about preserving history when he's stopped blocking the Wayback Machine from archiving his site. Edit: The good work someone has done is no excuse for anything. > The problem is that the internet is not like any other time in human history: everything we ever say and do gets recorded and indexed, all readily available to anyone curious, for all of time. This is new, and it's something that soc…

Hello, I removed the archive.is check, and requested the entire site to be crawled, which is now done. The entire site is mirrored here: http://archive.is/byuu.org I also sent an e-mail to the archive.org staff requesting the exclusion to be removed. I hope this will satisfy your request, and that you can sympathize with why I chose not to do this until retiring.

Excellent! Though it seems there is still a user-agent check in place -- visiting your site with an archivebot user-agent just shows "403 Forbidden".

The emulator design articles you've written are interesting and valuable, and I'm glad that they will be preserved for future emulator developers to read.

Re: Farewell

#75
post #71

Earlier quoted context omitted.

Hello, I removed the archive.is check, and requested the entire site to be crawled, which is now done. The entire site is mirrored here: http://archive.is/byuu.org I also sent an e-mail to the archive.org staff requesting the exclusion to be removed. I hope this will satisfy your request, and that you can sympathize with why I chose not to do this until retiring.

Excellent! Though it seems there is still a user-agent check in place -- visiting your site with an archivebot user-agent just shows "403 Forbidden". The emulator design articles you've written are interesting and valuable, and I'm glad that they will be preserved for future emulator developers to read.

Oh, sorry I forgot I also had user-agent checks in the code, good catch! archive.is checking was based on IP ranges, since they spoof their user agents as Chrome and use proxies. I removed that too now. All that should be left is a noindex tag on the 1,200 individual game pages at byuu.org/preservation (which I'm told is very important for web indexers; they're all auto-generated thin-content pages.) I believe both archive.is and archive.org ignore noindex anyway, and the full databases are on GitHub at icarus/Database. We should be all good now, but let me know if you find any other issues please.

I don't know how long it'll take for archive.org to remove the exclusion. Requesting it originally took a couple weeks. But they have my approval to start indexing it all again in any case.

I've already paid up for the next year of hosting, so the site should hopefully remain online at least that long, but I might not pay for it forever in the possible event I don't return, so if folks want it mirrored in even more places, now is the time.

Post reply on HN