Earlier quoted context omitted.
With cheap 20+Tb drives available, just buy a new drive every couple of years and copy the files forward.
PAR archives FTW :)
To preserve their work journalists take archiving into their own hands
41–50 of 94 posts
Re: To preserve their work journalists take archiving into their own hands
#42They should really collaborate with archive.org. They won't shut things down or paywall it.
Except when https://news.ycombinator.com/item?id=41135450
Re: To preserve their work journalists take archiving into their own hands
#43Earlier quoted context omitted.
What are some of those options?
There’s an addon called single file, you can use it to save the whole page with assets (except videos) https://github.com/gildas-lormeau/SingleFile
Safari has this, it can save as a Web Archive which is a sort of zip containing the html and assets.
Re: To preserve their work journalists take archiving into their own hands
#44Earlier quoted context omitted.
There’s an addon called single file, you can use it to save the whole page with assets (except videos) https://github.com/gildas-lormeau/SingleFile
Is there a to that I can script, to use the cookies on my existing web browser (because I'm logged into some websites) and get the page content text? All while clicking away pop-up banners (newsletter, cookies, etc)? I would script that to go over my local bookmarks file.
Reader mode does this in Safari. Adding to Reading List also stores the content for offline reading.
I bookmark to a service (Linkding, self-hosted) that automatically sends the URL to be archived at Wayback Machine.
Re: To preserve their work journalists take archiving into their own hands
#45I'm not a particularly good writer, but I've written about how I use the SingleFile extension to capture a perma web version of everything interesting that I read[0]. It's a great open source tool that aids in archiving (even if only at the personal level).
I've been taking notes and blogging since the early 2000s and coming back so often to find the content that I'd linked to has disappeared.
Archive.org and Archive Team do amazing work, but it's a mistake to put all your archiving eggs in one basket.
[0]: https://vertis.io/2024/01/26/how-singlefile-transformed-my-o...
Re: To preserve their work journalists take archiving into their own hands
#46Earlier quoted context omitted.
Is there a to that I can script, to use the cookies on my existing web browser (because I'm logged into some websites) and get the page content text? All while clicking away pop-up banners (newsletter, cookies, etc)? I would script that to go over my local bookmarks file.
Reader mode does this in Safari. Adding to Reading List also stores the content for offline reading. I bookmark to a service (Linkding, self-hosted) that automatically sends the URL to be archived at Wayback Machine.
Thank you. I should have been clearer and mentioned that I'm on Debian ))
But in any case, Safari's reader mode can be scripted from the CLI? That is good to know, maybe I'll try to find something similar for Firefox's Reader Mode. Thank you.
Re: To preserve their work journalists take archiving into their own hands
#47Earlier quoted context omitted.
Archive.org is such a godsend.- The entire information 'substrate' of society is ephemeral , if digital, and none (at least not enough) seem to have noticed .-
Two big issues with Archive.org are that 1. it's a single point of failure, they don't encourage mirror sites to emerge, and 2. they keep using the "brand" to fight unwinnable battles like hosting books they don't own online, risking the whole endeavor. I still appreciate it, but just imagine if it goes down due to a lawsuit. Now that Google no longer shows cached results, an entire historical record would be gone.
Re: To preserve their work journalists take archiving into their own hands
#48Earlier quoted context omitted.
Two big issues with Archive.org are that 1. it's a single point of failure, they don't encourage mirror sites to emerge, and 2. they keep using the "brand" to fight unwinnable battles like hosting books they don't own online, risking the whole endeavor. I still appreciate it, but just imagine if it goes down due to a lawsuit. Now that Google no longer shows cached results, an entire historical record would be gone.
https://github.com/internetarchive/dweb-mirror
If you check the issues, you'll learn this is not a supported project anymore (and honestly, it hardly worked even back then).
Re: To preserve their work journalists take archiving into their own hands
#49A nice social attack is to create an internet archive looking website call it archive.newtld and use it to create social proof of things you didn't actually do. "Oh yeah the Washington Post did a redesign but here are my past 10 posts which I saved in archive: link " In post truth internet, proving archives is going to be tough and unless there's some other form of verification it's going to be useless fast for "prov…
Could this be solved by digital signatures on web content? (Or, a way to store those)
Yes, pretty easily. In general actively faking old data, and especially faking it to convince the public is not what should be our main concern. Any given archive site can try that once, with high risk of quickly being caught.
Re: To preserve their work journalists take archiving into their own hands
#50Earlier quoted context omitted.
Reader mode does this in Safari. Adding to Reading List also stores the content for offline reading. I bookmark to a service (Linkding, self-hosted) that automatically sends the URL to be archived at Wayback Machine.
Thank you. I should have been clearer and mentioned that I'm on Debian )) But in any case, Safari's reader mode can be scripted from the CLI? That is good to know, maybe I'll try to find something similar for Firefox's Reader Mode. Thank you.
Yes. On macOS we would generally use osascript on the command line. Apple Script Editor shows which functions each app exposes. Very powerful combo.