Can you configure this tool to login to websites (for paid news subscriptions) and get past those paywalls?
Yeah, it supports it but there are security considerations if you're doing it for anything more serious than news content. See here: https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overv...
Make Your Own Internet Archive with Archive Box
71–80 of 81 posts
Re: Make Your Own Internet Archive with Archive Box
#72Earlier quoted context omitted.
There's a link to more info on the Chrome thing but it 404s https://github.com/c9fe/22120/issues/57
http://web.archive.org/web/20201206153345/https://github.com...
I've got lots of these archives of issues and comments lying around. It's good to see more!
Btw i knew you'd show up on a comment thread where i posted my stuff. You're like obsessed with my project, right? Why, haha? Maybe because you've got you own archive project, the archive box. "Competition". Hahaha. I hope you haven't got to the point of "search alerts" obsessed, hahaha, don't fret too much, niki pirate! Everyone check out pirate's the archive box, he made the trip here, do him a favor!
https://github.com/ArchiveBox/ArchiveBox
Thanks for showing up niiki, it's good to see you again. See you next time!
Re: Make Your Own Internet Archive with Archive Box
#73Earlier quoted context omitted.
Wow, your reading comprehension is amazingly good. Yep, that's correct.
There's a link to more info on the Chrome thing but it 404s https://github.com/c9fe/22120/issues/57
But at any time, it may just come back, you know? Boom.. and then it's back. Haha !
Which suits me perfectly for where i am right now. :)
Re: Make Your Own Internet Archive with Archive Box
#74How does archive.is trick news sites into showing content without the paywall? Is it pure user agent spoofing? I'm wondering if this could be applied here.
Yeup, just the reason why we expose the USER_AGENT options in ArchiveBox config ;) https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overv... I don't want to officially endorse using the Google bot user agent, but you're welcome to try it on your own and see if it improves the experience.
Re: Make Your Own Internet Archive with Archive Box
#75Earlier quoted context omitted.
http://web.archive.org/web/20201206153345/https://github.com...
Thank you for saving that, pirate niki! I think i saved a copy as well, right? Yep, here https://archive.is/jcURO I've got lots of these archives of issues and comments lying around. It's good to see more! Btw i knew you'd show up on a comment thread where i posted my stuff. You're like obsessed with my project, right? Why, haha? Maybe because you've got you own archive project, the archive box. "Competition". Hahaha…
Re: Make Your Own Internet Archive with Archive Box
#76Earlier quoted context omitted.
Thank you for saving that, pirate niki! I think i saved a copy as well, right? Yep, here https://archive.is/jcURO I've got lots of these archives of issues and comments lying around. It's good to see more! Btw i knew you'd show up on a comment thread where i posted my stuff. You're like obsessed with my project, right? Why, haha? Maybe because you've got you own archive project, the archive box. "Competition". Hahaha…
I didn't save it, it was picked up by archive.org's own crawler in Nov. Also I think you're way overthinking this, I just saw this because it's a comment thread on a post about ArchiveBox. It's a little weird that you frame it as competition, there are plenty of open source archiving projects, it's not a war. We can be civil, you don't have to mock me or do stuff like blocking me on Github, I have no beef with 22120.
Re: Make Your Own Internet Archive with Archive Box
#77Re: Make Your Own Internet Archive with Archive Box
#78Earlier quoted context omitted.
Yeah, it supports it but there are security considerations if you're doing it for anything more serious than news content. See here: https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overv...
Thanks, much appreciated. This is a very informative set of things to watch out for that I wouldn't have thought of otherwise.
Re: Make Your Own Internet Archive with Archive Box
#79Earlier quoted context omitted.
Thank you for saving that, pirate niki! I think i saved a copy as well, right? Yep, here https://archive.is/jcURO I've got lots of these archives of issues and comments lying around. It's good to see more! Btw i knew you'd show up on a comment thread where i posted my stuff. You're like obsessed with my project, right? Why, haha? Maybe because you've got you own archive project, the archive box. "Competition". Hahaha…
I didn't save it, it was picked up by archive.org's own crawler in Nov. Also I think you're way overthinking this, I just saw this because it's a comment thread on a post about ArchiveBox. It's a little weird that you frame it as competition, there are plenty of open source archiving projects, it's not a war. We can be civil, you don't have to mock me or do stuff like blocking me on Github, I have no beef with 22120.
Re: Make Your Own Internet Archive with Archive Box
#80Earlier quoted context omitted.
Thank you for saving that, pirate niki! I think i saved a copy as well, right? Yep, here https://archive.is/jcURO I've got lots of these archives of issues and comments lying around. It's good to see more! Btw i knew you'd show up on a comment thread where i posted my stuff. You're like obsessed with my project, right? Why, haha? Maybe because you've got you own archive project, the archive box. "Competition". Hahaha…
I didn't save it, it was picked up by archive.org's own crawler in Nov. Also I think you're way overthinking this, I just saw this because it's a comment thread on a post about ArchiveBox. It's a little weird that you frame it as competition, there are plenty of open source archiving projects, it's not a war. We can be civil, you don't have to mock me or do stuff like blocking me on Github, I have no beef with 22120.