Live data from Hacker News

Wayback Machine was down

web.archive.org

21–30 of 34 posts

Re: Wayback Machine was down

#21
I sent them a bug yesterday where I was being blocked for "Too Many Requests" regarding an endpoint I wasn't actually using (they thought I was attempting to submit URLs using the "Save Page Now" feature), so they've been having issues across the board.

This is good though, as they're now hopefully aware of some previously unknown deficiencies.

Best of luck to the Archive team to get things up and running again with minimal stress!

Re: Wayback Machine was down

#22
post #17
post #14

Earlier quoted context omitted.

Downvotes! Yep, this is exactly why we have crappy infrastructure.

FYI: downvotes because (0) off-topic, (a) not constructive, (b) the world is bigger than California and there’s a lot of great infrastructure elsewhere, (c) PG&E is probably about average, (d) complaining about downvotes without thinking about why people had reason to downvote you.

Downvoted you only because PG&E is way worse than average. Just yesterday they agreed to plead guilty to 84 counts of manslaughter, and I could go on and on about their wrongdoing. Much related to not doing maintenance and then falsifying maintenance reports. I moved out of their service area a decade ago, still hate them.

All other points are fair, though.

Re: Wayback Machine was down

#23
post #6

The Internet Archive just announced a no-waitlist book lending due to COVID-19, I'd guess their servers might not be too happy about the inrush of users. http://blog.archive.org/2020/03/24/announcing-a-national-eme...

Right, and https://archive.org/details/nationalemergencylibrary is up and responsive.

So I'm guessing that they've shifted resources.

Re: Wayback Machine was down

#24
post #12

Now would be a great time to donate to the Internet Archive if you're able to. They can surely use the help.

If only shareholders would think the same way about PG&E and other companies that could use infrastructure upgrades ...

PG&E is so far behind on deferred maintenance that people have been petitioning for California to socialize it so the state stops catching on fire from high tension powerlines.

You will be glad to know that they've protected executive bonuses, though.

Re: Wayback Machine was down

#25
post #24
post #12

Earlier quoted context omitted.

If only shareholders would think the same way about PG&E and other companies that could use infrastructure upgrades ...

PG&E is so far behind on deferred maintenance that people have been petitioning for California to socialize it so the state stops catching on fire from high tension powerlines. You will be glad to know that they've protected executive bonuses, though.

Didn't PG&E get blocked from performing upgrades by the state utilities commission? Something about not wanting to increase power customer bills... utility incentives are not easy.

Re: Wayback Machine was down

#26
post #13

Earlier quoted context omitted.

The kiwix Wikipedia-en full scrape with images has been broken for over 18 months, I think they could use some technical help. I tried running their scraper myself on a nice AWS instance and it just stalls after many days of downloading articles. Could probably use a rewrite. ;) https://sourceforge.net/p/kiwix/discussion/604121/thread/1f2... https://github.com/openzim/mwoffliner/issues/1020 https://github.com/openzim…

The whole zim file infrastructure is pretty broken. I've been trying to put together a system for generating a WARC file by rendering all the wikitext content in a database dump, which is a lot more reasonable of an approach. Rendering wikitext is challenging though, since wikitext can include chunks of other wikitext, and wikitext can use some pretty complicated templating functionality. Oddly enough where I've run…

This sounds like a really cool project, maybe someone from Wikimedia will be willing to help you figure out the process. I'll try to dig up the right contacts for you.

You could start by asking here: https://meta.wikimedia.org/wiki/Grants_talk:Project

Re: Wayback Machine was down

#28
post #22
post #17

Earlier quoted context omitted.

FYI: downvotes because (0) off-topic, (a) not constructive, (b) the world is bigger than California and there’s a lot of great infrastructure elsewhere, (c) PG&E is probably about average, (d) complaining about downvotes without thinking about why people had reason to downvote you.

Downvoted you only because PG&E is way worse than average. Just yesterday they agreed to plead guilty to 84 counts of manslaughter, and I could go on and on about their wrongdoing. Much related to not doing maintenance and then falsifying maintenance reports. I moved out of their service area a decade ago, still hate them. All other points are fair, though.

I'm glad that you are out of their service area we need more people like you

Re: Wayback Machine was down

#30

In the meantime, distributed archiving ftw, run your own archives with Webrecorder.io, ArchiveBox.io, SingleFile, kiwix.org, etc!

Is there a tool that downloads every website I visit locally and then, upon revisit, shows me my local copy for instant load, but does a diff in the background with the online version and asks me to show newer version only if there are differences?
Post reply on HN