Internet Archive Infrastructure
archive.org
Internet Archive Infrastructure
1–10 of 114 posts
Re: Internet Archive Infrastructure
#2The Internet Archive is incredibly commendable! It's impressive that such a small organization can do so much. I wish they would fix the Wayback Machine being broken in Firefox, though.
Re: Internet Archive Infrastructure
#3The Internet Archive is incredibly commendable! It's impressive that such a small organization can do so much. I wish they would fix the Wayback Machine being broken in Firefox, though.
> Wayback Machine being broken in Firefox
Are you getting "Fail with status: 498 No Reason Phrase"? You might have your Referer header disabled.
If that's the case, you can fix it by going to about:config and setting network.http.sendRefererHeader to 2 (or pressing the reset button to the right).
Re: Internet Archive Infrastructure
#4The Internet Archive is incredibly commendable! It's impressive that such a small organization can do so much. I wish they would fix the Wayback Machine being broken in Firefox, though.
> Wayback Machine being broken in Firefox Are you getting "Fail with status: 498 No Reason Phrase"? You might have your Referer header disabled. If that's the case, you can fix it by going to about:config and setting network.http.sendRefererHeader to 2 (or pressing the reset button to the right).
I am! Thank you! Why doesn't it work without REFERER headers? I haven't changed any settings from the Firefox default, and allowing it breaks links to jwz's site.
Re: Internet Archive Infrastructure
#5This is a recent video presentation by Jonah Edwards, who runs the Core Infrastructure Team at the Internet Archive. He explains the IA’s server, storage, and networking infrastructure, and then takes questions from other people at the Archive.
I found it all interesting. But the main takeaway for me is his response to Brewster Kahle’s question, beginning at 13:06, about why the IA does everything in-house rather than having its storage and processing hosted by, for example, AWS. His answer: lower cost, greater control, and greater confidence that their users are not being tracked.
Re: Internet Archive Infrastructure
#6Earlier quoted context omitted.
> Wayback Machine being broken in Firefox Are you getting "Fail with status: 498 No Reason Phrase"? You might have your Referer header disabled. If that's the case, you can fix it by going to about:config and setting network.http.sendRefererHeader to 2 (or pressing the reset button to the right).
I am! Thank you! Why doesn't it work without REFERER headers? I haven't changed any settings from the Firefox default, and allowing it breaks links to jwz's site.
> Why doesn't it work without REFERER headers?
Don't know. I just spotted that it's the only meaningful difference I had in my traffic between visiting with Firefox and with Chromium. IIRC, it's the fetching of the capture timestamps that fails when the Referer header is missing.
> I haven't changed any settings from the Firefox default
You might have forgotten like I did once.
> and allowing it breaks links to jwz's site.
Do you mean this one?
Seems to be working fine for me with the Referer header enabled. Maybe it was a temporary glitch?
Re: Internet Archive Infrastructure
#7Earlier quoted context omitted.
I am! Thank you! Why doesn't it work without REFERER headers? I haven't changed any settings from the Firefox default, and allowing it breaks links to jwz's site.
> Why doesn't it work without REFERER headers? Don't know. I just spotted that it's the only meaningful difference I had in my traffic between visiting with Firefox and with Chromium. IIRC, it's the fetching of the capture timestamps that fails when the Referer header is missing. > I haven't changed any settings from the Firefox default You might have forgotten like I did once. > and allowing it breaks links to jwz's…
It won't if you click a jwz link from Hacker News. It shows you a testicle in an egg cup. This is on purpose.
Re: Internet Archive Infrastructure
#8Earlier quoted context omitted.
I am! Thank you! Why doesn't it work without REFERER headers? I haven't changed any settings from the Firefox default, and allowing it breaks links to jwz's site.
> Why doesn't it work without REFERER headers? Don't know. I just spotted that it's the only meaningful difference I had in my traffic between visiting with Firefox and with Chromium. IIRC, it's the fetching of the capture timestamps that fails when the Referer header is missing. > I haven't changed any settings from the Firefox default You might have forgotten like I did once. > and allowing it breaks links to jwz's…
[deleted]
Re: Internet Archive Infrastructure
#9Earlier quoted context omitted.
> Why doesn't it work without REFERER headers? Don't know. I just spotted that it's the only meaningful difference I had in my traffic between visiting with Firefox and with Chromium. IIRC, it's the fetching of the capture timestamps that fails when the Referer header is missing. > I haven't changed any settings from the Firefox default You might have forgotten like I did once. > and allowing it breaks links to jwz's…
It won't if you click a jwz link from Hacker News. It shows you a testicle in an egg cup. This is on purpose.
Can confirm. :(
Re: Internet Archive Infrastructure
#10This is a recent video presentation by Jonah Edwards, who runs the Core Infrastructure Team at the Internet Archive. He explains the IA’s server, storage, and networking infrastructure, and then takes questions from other people at the Archive. I found it all interesting. But the main takeaway for me is his response to Brewster Kahle’s question, beginning at 13:06, about why the IA does everything in-house rather tha…
I assume the 200PB of storage and 60Gbps egress bandwidth 24/365 they do would be _extremely_ pricy on AWS...