This has been playing out for many years. And it's all because Brewster Kahle decided that an overly broad interpretation of the Internet Archive's mission trumped the rights of authors and publishers, and the laws of the United States. When IA was asked to stop CDL - many times - he continued. The National Writers Union tried to open a dialogue as early as 2010 but was ignored: The Internet Archive says it would rat…
For those of you who are just learning that name from this lawsuit, here's his wikipedia page:
https://en.wikipedia.org/wiki/Brewster_Kahle
Kahle founded the Archive in the nineties, in the midst of the fairly determined attempts at that time to either delay or even re-engineer the early Internet to be more respectful of existing intellectual property and decency laws.
We inherit a searchable, saveable web, because of the work done then to establish the norm that the Internet itself should exist, and that open digital archives can exist, legally. Many many people worked on the first issue. But Kahle played a far far larger role in the second battle.
So these "noble aspects" of "real value to society", as you rightly describe them, came from fighting for them -- by rolling them into existence in the face of opposition and skepticism.
So I understand the concern that this court decision threatens the future of some forms of archiving, digital preservation and librarianship. But the existing norms and repositories this threatens exist because people established those norms and archiving projects before now, in living memory, even in the face of threats and lectures about precedent and worries about legal gray areas.
If you want to defend and protect "the many noble aspects of the archive", you have to remember that thirty years ago, those were imagined as impossible, impractical, and (whisper it) probably illegal. In both cases, it was Kahle's vision and approach that was -- apparently -- the only way it was going to get done.
So I profoundly disagree that this is somehow a wild chase out of the safe and respectable grounds of the Archive's core mission. The Archive's core mission got to be respectable because Kahle chased the wild idea, and established its right to exist.
That may sound like I'm overstating Kahle's role, and/or overstating the initially radical, now widely-respected nature of pretty much everything the Archive has done.
But if it's not the case -- why is there only one Internet Archive? Why didn't other people, other national archives, other commercial concerns or non-profits join in this work? Why did only Kahle do it, and why was it only Kahle coming up with CDL as an idea to prevent the death of first sale, of lending a book, of the idea of a free library in a digital future? There should be more ideas, more Internet Archives, of course, for safety's sake. But absolutely nothing about Kahle's mission to create a library of and on the Internet was ever "safe".