Live data from Hacker News

Internet Archive is now a federal depository library

kqed.org

41–50 of 62 posts

Re: Internet Archive is now a federal depository library

#41

My take on this is that in desperation to become a real library despite Kahle's radical hatred of content creators, Kahle will end up dragging the legislative narrative in a direction that takes down real libraries with him. He will almost certainly broadcast his status as a federal depository library as part of his defenses in his numerous lawsuits. One selfish man unwilling to recognize he is doing more harm than g…

They were already recognized by the state of California as a library, and have received federal funds for infrastructure under that designation. They’ve also been accepted into consortiums made up of other libraries in the US. Whether you believe they’re a library is immaterial.

A federal Judge also ruled that "IA does not perform the traditional functions of a library."

https://publishers.org/wp-content/uploads/2024/09/2024.09.04...

Brewster has a friend in a state senator and he's trying to do what he can to preserve his section 108 privileges. He's removed over a million items in the past year after being repeatedly sued for copyright infringement, and leaked millions of private communications with patrons including passports and driver licenses. That's the undercurrent here.

Egos aside, the goal isn't to be a library: it's providing access to knowledge. But when your site is on the blocklist at public library terminals because you keep getting flagged for copyright violations and child pornography, maybe you're not on the path.

Re: Internet Archive is now a federal depository library

#42

Earlier quoted context omitted.

They were already recognized by the state of California as a library, and have received federal funds for infrastructure under that designation. They’ve also been accepted into consortiums made up of other libraries in the US. Whether you believe they’re a library is immaterial.

A federal Judge also ruled that "IA does not perform the traditional functions of a library." https://publishers.org/wp-content/uploads/2024/09/2024.09.04... Brewster has a friend in a state senator and he's trying to do what he can to preserve his section 108 privileges. He's removed over a million items in the past year after being repeatedly sued for copyright infringement, and leaked millions of private communica…

[deleted]

Re: Internet Archive is now a federal depository library

#43
post #9

Earlier quoted context omitted.

They already remove “inconvenient” webpages on the Wayback Machine if someone asks nicely enough. If I remember correctly, if you use it to save a software company’s documentation pages or evidence of something embarrassing like a potential data breach, they could remove it if the company asks. I think Oracle might have done something like this before.

If anyone reading knows an easy way to download and mirror IA pages please make it easier to find. A bot told me they offer downloads of the underlying WARC files but I could not find it

They locked away most .warc files due to the AI harvesting crunch.

Re: Internet Archive is now a federal depository library

#44
post #15

Earlier quoted context omitted.

Kiwifarms as well. They are a bit of a pushover when it comes to controversy.

I thought Archive just removed access, but kept the content. I know that from a user perspective that is a distinction without a difference, but for posterity it matters. Does anyone have any facts/citations on if this is a myth/coping mechanism I created, or reality?

In the past, they stated that they do not delete anything. Those posts have vanished, possibly due to the onslaught of lawsuits and discovery. Specific to Kiwi Farms (and some other material) I was able to locate it by poking around on the site. Even the material that the Judge ruled against in the Hachette lawsuit remains online and available to people with print disabilities.

Re: Internet Archive is now a federal depository library

#45

My take on this is that in desperation to become a real library despite Kahle's radical hatred of content creators, Kahle will end up dragging the legislative narrative in a direction that takes down real libraries with him. He will almost certainly broadcast his status as a federal depository library as part of his defenses in his numerous lawsuits. One selfish man unwilling to recognize he is doing more harm than g…

"radical hatred of content creators" is a very harsh and specific allegation. I wasn't aware that Kahle was considered such a bad actor. I did some googling and wikipedia-ing and can't see much that supports that claim. I am very open minded to the nuances of IP rights vs information-wants-to-be-free so I'd love to hear more details about your position particularly as it relates to the federal depository designation.

Re: Internet Archive is now a federal depository library

#46

Earlier quoted context omitted.

What is "outdated material" for a library? Isn't that precisely where you go to find "outdated material" is a library's archives?

Stuff like the printed tax code of 1965 or Borland Pascal 1992 manual. Once you have it digitized it's a waste of space for libraries to have a physical copy because basically no one needs it.

In other words, a depository is cold storage

Re: Internet Archive is now a federal depository library

#47
post #9

Earlier quoted context omitted.

They already remove “inconvenient” webpages on the Wayback Machine if someone asks nicely enough. If I remember correctly, if you use it to save a software company’s documentation pages or evidence of something embarrassing like a potential data breach, they could remove it if the company asks. I think Oracle might have done something like this before.

If anyone reading knows an easy way to download and mirror IA pages please make it easier to find. A bot told me they offer downloads of the underlying WARC files but I could not find it

> A bot told me they offer downloads of the underlying WARC files but I could not find it

The "bot" is wrong. Most of the crawl data used by the Internet Archive, particularly the Alexa crawls, isn't publicly accessible. (This is because some of it includes archived pages which have since been suppressed by the site owner - removing those pages from the archived crawl data isn't practical.)

https://archive.org/details/alexacrawls

Common Crawl data is public, but less comprehensive than IA - https://commoncrawl.org/

Re: Internet Archive is now a federal depository library

#48
post #9

Earlier quoted context omitted.

They already remove “inconvenient” webpages on the Wayback Machine if someone asks nicely enough. If I remember correctly, if you use it to save a software company’s documentation pages or evidence of something embarrassing like a potential data breach, they could remove it if the company asks. I think Oracle might have done something like this before.

If anyone reading knows an easy way to download and mirror IA pages please make it easier to find. A bot told me they offer downloads of the underlying WARC files but I could not find it

I used wayback-machine-downloader, I think you need one of the forks to make it work though.

https://github.com/hartator/wayback-machine-downloader

Re: Internet Archive is now a federal depository library

#49
post #22

I'm having trouble finding what this means. Does IA now have new obligations, or gets new information, or something else, or all of the above? The submission says: > These records account for “millions and millions of pages” that can take up entire floors of public libraries, Kahle said. San Diego’s public library gave up its federal depository status in 2020 because its government documents took up so much space and…

As I understand it, it’s voluntary and like the government document version of the Twitter firehose. Direct access to all published government documents as they are created.

Re: Internet Archive is now a federal depository library

#50
post #19

Back in the days when things were sane my first thought reading this headline would have been: Nice, that‘s sounds official and important. Nowadays my first thought is: Wait, does this mean Trump can mess around with this?

That says more about you than it says about the times, I'm afraid. Your first thought should still be the former, not the latter.
Post reply on HN