The queue has been in 5 digit numbers for a few days. And for a few weeks before that it was possible to get articles archived by archiving them when americans are sleeping (at GMT morning). Nowadays it is no longer possible and the waiting line is about 2-3 days. What on Earth is going on?
Ask HN: What is going on at archive.ph?
1–10 of 13 posts
Re: Ask HN: What is going on at archive.ph?
#2In times like these I always like to urge people to figure out what these services are that you like using online and see if there are ways that you could roll them yourself at home for your own personal use.
Re: Ask HN: What is going on at archive.ph?
#3In times like these I always like to urge people to figure out what these services are that you like using online and see if there are ways that you could roll them yourself at home for your own personal use.
So with stuff like SearX, invidious, nitter, etc you can run your own instance.
Can you run your own instance of archive.ph? Obviously not their software (they don't release it), but is there a version you can run yourself?
The important parts of what archive.ph provides are:
1. Headless chromium that works around 99.9% of the "headless fingerprinter" techniques. Yes, they do actually spin up a full browser engine; that's what sets them apart.
2. Decent curated collection of paywall-bypass tactics.
#2 is definitely available from other sources. So really what we're looking for is a one-click "headless chromium that deals with 99.9% of the fingerprint detectors".
Re: Ask HN: What is going on at archive.ph?
#4In times like these I always like to urge people to figure out what these services are that you like using online and see if there are ways that you could roll them yourself at home for your own personal use.
So with stuff like SearX, invidious, nitter, etc you can run your own instance. Can you run your own instance of archive.ph? Obviously not their software (they don't release it), but is there a version you can run yourself? The important parts of what archive.ph provides are: 1. Headless chromium that works around 99.9% of the "headless fingerprinter" techniques. Yes, they do actually spin up a full browser engine; t…
It’s not strictly the same but ArchiveBox is very well maintained and recognised for personal archives
Re: Ask HN: What is going on at archive.ph?
#5Earlier quoted context omitted.
So with stuff like SearX, invidious, nitter, etc you can run your own instance. Can you run your own instance of archive.ph? Obviously not their software (they don't release it), but is there a version you can run yourself? The important parts of what archive.ph provides are: 1. Headless chromium that works around 99.9% of the "headless fingerprinter" techniques. Yes, they do actually spin up a full browser engine; t…
It’s not strictly the same but ArchiveBox is very well maintained and recognised for personal archives https://github.com/ArchiveBox/ArchiveBox
Clueless here. What sort of “personal archiving” are you talking about? Like Evernote? I’ve only ever used archive.ph to facilitate sharing articles without worrying about links changing (looking at you, BBC).
Re: Ask HN: What is going on at archive.ph?
#6Earlier quoted context omitted.
It’s not strictly the same but ArchiveBox is very well maintained and recognised for personal archives https://github.com/ArchiveBox/ArchiveBox
Clueless here. What sort of “personal archiving” are you talking about? Like Evernote? I’ve only ever used archive.ph to facilitate sharing articles without worrying about links changing (looking at you, BBC).
For example if you want to save a web page you're browsing, or a whole website, in a way that is a bit more reliable than hitting ctrl+s; and then want to search through those etc.
Web archival is a very, very complex and deep topic. If you're interested in it, the archiveteam's wiki is a good resource. Start here, I think:
https://wiki.archiveteam.org/index.php/Introduction
Re: Ask HN: What is going on at archive.ph?
#7Earlier quoted context omitted.
So with stuff like SearX, invidious, nitter, etc you can run your own instance. Can you run your own instance of archive.ph? Obviously not their software (they don't release it), but is there a version you can run yourself? The important parts of what archive.ph provides are: 1. Headless chromium that works around 99.9% of the "headless fingerprinter" techniques. Yes, they do actually spin up a full browser engine; t…
It’s not strictly the same but ArchiveBox is very well maintained and recognised for personal archives https://github.com/ArchiveBox/ArchiveBox
Just a few hours ago I tried ArchiveBox again. Used the docker-compose version, imported around 600 bookmarks and... 5 hours later everything is pending, it has stopped creating new files and folders in the data folder, and I have no idea how to find out what's wrong.
I'm not terribly motivated right now to dive into the community and ask for help, so I won't seriously complain, but it's at least not trivial to use.
Re: Ask HN: What is going on at archive.ph?
#8Works alright for me. Maybe you've been rate limited?
Re: Ask HN: What is going on at archive.ph?
#9Works alright for me. Maybe you've been rate limited?
What is the average number you see after submitting the link? Mine are in 20.000
Re: Ask HN: What is going on at archive.ph?
#10In times like these I always like to urge people to figure out what these services are that you like using online and see if there are ways that you could roll them yourself at home for your own personal use.
I use this from time to time to archive web page for my own use
https://github.com/webrecorder/archiveweb.page
I also convert web snippets I find useful to the markdown format and store it in my Joplin notebook, so that way it lives on even if the website is gone.