Live data from Hacker News

The Internet Archive is back online

arstechnica.com

11–20 of 107 posts

Re: The Internet Archive is back online

#11
post #2

It would be better if the Internet Archive was decentralized without a central point of failure, maybe run on something like bittorent.

You say this as if it is an original idea. Of course the IA is working on this and have been for over 6 years. There already is a DWeb version. They have been advancing DWeb infrastructure. The IA hosts all kinds of DWeb developer events. But it is over 50 petabytes and the IA gets a huge amount of traffic through the regular web that they need to serve quickly and efficiently to their users. Guess what has happened…

It is not my original idea, but it is an obvious idea to anyone who knows how the internet works, I just added it to get the discussion going.

Re: The Internet Archive is back online

#12
post #8
post #2

It would be better if the Internet Archive was decentralized without a central point of failure, maybe run on something like bittorent.

I don't know if bittorrent has improved - but 20 years ago I had a personal issue with it. At that time our son was using it for games. He goes away to college and came home for the first school break. I get a phone call from our internet provider asking if our son was home. I was so shocked and handed the phone to our son. Apparently at that time bittorrent was optimizing for the most efficient path to a host. Since…

All clients today (and probably back then) have options to limit bandwidth consumption including throttling, scheduling, and total data transfer caps. For serving mostly HTML and images, dedicating even 10% of a home broadband connection to serving content would allow many, many people per day to access archived pages.

Re: The Internet Archive is back online

#14
post #2

It would be better if the Internet Archive was decentralized without a central point of failure, maybe run on something like bittorent.

The problem is that it's hard to do this in a way that ensures good archival of ALL resources. Bittorrent works well for popular things but fails for marginal content (unless some really dedicated individuals step in.) What the internet archive provides is a way to have access to many many resources which you didn't know you needed in advance.

[deleted]

Re: The Internet Archive is back online

#15
post #13

When the internet archive censors a website is it deleted permanently or just not publicly available?

I don't think they censor anything, strictly archiving. Do you know of any instance in which they censored a site?

http://web.archive.org/web/20240000000000*/twitter.com/taylo...

For one. I'm just curious what their policy is.

Re: The Internet Archive is back online

#16
post #11

Earlier quoted context omitted.

You say this as if it is an original idea. Of course the IA is working on this and have been for over 6 years. There already is a DWeb version. They have been advancing DWeb infrastructure. The IA hosts all kinds of DWeb developer events. But it is over 50 petabytes and the IA gets a huge amount of traffic through the regular web that they need to serve quickly and efficiently to their users. Guess what has happened…

It is not my original idea, but it is an obvious idea to anyone who knows how the internet works, I just added it to get the discussion going.

It already exists. IA has had a DWeb for 6 years. Nobody seeds it.

Re: The Internet Archive is back online

#17

When the internet archive censors a website is it deleted permanently or just not publicly available?

They black out all items that get a DMCA complaint or similar request (so it's still there just not accessible). However they permanently delete illegal stuff.

Re: The Internet Archive is back online

#18

When the internet archive censors a website is it deleted permanently or just not publicly available?

They black out all items that get a DMCA complaint or similar request (so it's still there just not accessible). However they permanently delete illegal stuff.

I would assume they delete illegal stuff as they are compelled to. What I'd like to know is their policy for legal stuff that they exclude that is not as a result of DMCA.

Re: The Internet Archive is back online

#19
post #4
post #3

Earlier quoted context omitted.

I kind of agree, but the way the internet is going, with everyone being behind carrier-grade nat, it's not much of a decentralized network of computers anymore, not to mention all the kids with their laptops and tablets not even hosting anything :(

UPnP exists and allow devices to ask the router to open a port to them.

That doesnt help with CGNAT.

Re: The Internet Archive is back online

#20
post #4
post #3

Earlier quoted context omitted.

I kind of agree, but the way the internet is going, with everyone being behind carrier-grade nat, it's not much of a decentralized network of computers anymore, not to mention all the kids with their laptops and tablets not even hosting anything :(

UPnP exists and allow devices to ask the router to open a port to them.

UPnP is just automating the process of forwarding ports, CGNAT will still screw you sideways because you're behind a router you can't access or order around.
Post reply on HN