Live data from Hacker News

Wayback Machine: Now with 240,000,000,000 URLs

blog.archive.org

11–20 of 38 posts

Re: Wayback Machine: Now with 240,000,000,000 URLs

#11

Seriously, the Wayback Machine is awesome. Just last week I used it to find a website I made twelve years ago at the ripe age of 10. If there are any maintainers/developers reading this, thank you. The fact that they were able to preserve a masterpiece like this means a lot to me: http://web.archive.org/web/20010124071800/http://expage.com/...

Clicked on Today's comics and felt very nostalgic when I saw this http://web.archive.org/liveweb/http://expage.com/cgibin/free...

Re: Wayback Machine: Now with 240,000,000,000 URLs

#12

Seriously, the Wayback Machine is awesome. Just last week I used it to find a website I made twelve years ago at the ripe age of 10. If there are any maintainers/developers reading this, thank you. The fact that they were able to preserve a masterpiece like this means a lot to me: http://web.archive.org/web/20010124071800/http://expage.com/...

> The fact that they were able to preserve a masterpiece like this means a lot to me

That's exactly the kind of website they should be preserving! The future people will be glad that we kept some ephemera around.

And I love that website - just so blue; and comic sans not used ironically; and animated gifs; and the guestbook.

Re: Wayback Machine: Now with 240,000,000,000 URLs

#13
post #8

Seriously, the Wayback Machine is awesome. Just last week I used it to find a website I made twelve years ago at the ripe age of 10. If there are any maintainers/developers reading this, thank you. The fact that they were able to preserve a masterpiece like this means a lot to me: http://web.archive.org/web/20010124071800/http://expage.com/...

Agreed. Back in '96 I was a teenager who spent all his free time running a modest gaming fan website [1]. I dropped it when I went to college a year later, but its nice to know all that hard work will forever be memorialized within the wayback machine. It helps me remember why I became a software engineer in the first place. Thanks for that. [1] http://web.archive.org/web/19970414022225/http://www.scorche...

> Best viewed in 800x600 resolution.

that's great ;-)

Re: Wayback Machine: Now with 240,000,000,000 URLs

#15
My only gripe with the wayback machine is that when old sites go offline and some random domain squatter picks up the domain when it expires, they apply the current robots.txt to all of the old content making archive.org useless.

robots.txt should have a limit; it shouldn't be applied retroactively so aggressively.

Re: Wayback Machine: Now with 240,000,000,000 URLs

#16

Does anyone know what database they use? Or just files and folders?

I only have second hand insight into how they do it, but my impression is that their spiders log the raw data right to disk and then, periodically (a few times a year?) they process all the accumulated data in one mind-bogglingly massive job. I don't know what the data goes in to as a result of this processing though.

Re: Wayback Machine: Now with 240,000,000,000 URLs

#18

My only gripe with the wayback machine is that when old sites go offline and some random domain squatter picks up the domain when it expires, they apply the current robots.txt to all of the old content making archive.org useless. robots.txt should have a limit; it shouldn't be applied retroactively so aggressively.

I suppose it's a pretty good approach in order to help avoid upsetting website owners and possible lawsuits. While I'm not too sure I agree with it, I can appreciate that they have provided a very easy way for websites to opt-out.

Re: Wayback Machine: Now with 240,000,000,000 URLs

#19

Seriously, the Wayback Machine is awesome. Just last week I used it to find a website I made twelve years ago at the ripe age of 10. If there are any maintainers/developers reading this, thank you. The fact that they were able to preserve a masterpiece like this means a lot to me: http://web.archive.org/web/20010124071800/http://expage.com/...

I find it hilarious that you animated the B flipping between italics and normal
Post reply on HN