Live data from Hacker News

Make Your Own Internet Archive with Archive Box

nixintel.info

71–80 of 81 posts

Re: Make Your Own Internet Archive with Archive Box

#71

Can you configure this tool to login to websites (for paid news subscriptions) and get past those paywalls?

Yeah, it supports it but there are security considerations if you're doing it for anything more serious than news content. See here: https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overv...

Thanks, much appreciated. This is a very informative set of things to watch out for that I wouldn't have thought of otherwise.

Re: Make Your Own Internet Archive with Archive Box

#72
post #57

Earlier quoted context omitted.

There's a link to more info on the Chrome thing but it 404s https://github.com/c9fe/22120/issues/57

http://web.archive.org/web/20201206153345/https://github.com...

Thank you for saving that, pirate niki! I think i saved a copy as well, right? Yep, here https://archive.is/jcURO

I've got lots of these archives of issues and comments lying around. It's good to see more!

Btw i knew you'd show up on a comment thread where i posted my stuff. You're like obsessed with my project, right? Why, haha? Maybe because you've got you own archive project, the archive box. "Competition". Hahaha. I hope you haven't got to the point of "search alerts" obsessed, hahaha, don't fret too much, niki pirate! Everyone check out pirate's the archive box, he made the trip here, do him a favor!

https://github.com/ArchiveBox/ArchiveBox

Thanks for showing up niiki, it's good to see you again. See you next time!

Re: Make Your Own Internet Archive with Archive Box

#73
post #57

Earlier quoted context omitted.

Wow, your reading comprehension is amazingly good. Yep, that's correct.

There's a link to more info on the Chrome thing but it 404s https://github.com/c9fe/22120/issues/57

I think the way it is now in the readme accurately reflects the state of development. Still possible, but not actively working on and not currently interested in any non chrome stuff.

But at any time, it may just come back, you know? Boom.. and then it's back. Haha !

Which suits me perfectly for where i am right now. :)

Re: Make Your Own Internet Archive with Archive Box

#74

How does archive.is trick news sites into showing content without the paywall? Is it pure user agent spoofing? I'm wondering if this could be applied here.

Yeup, just the reason why we expose the USER_AGENT options in ArchiveBox config ;) https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overv... I don't want to officially endorse using the Google bot user agent, but you're welcome to try it on your own and see if it improves the experience.

How does ArchiveBox function compared to https://archivarix.com? I recently used Archivarix to backup a large website (93k pages), but it messed up the js/css.

Re: Make Your Own Internet Archive with Archive Box

#75

Earlier quoted context omitted.

http://web.archive.org/web/20201206153345/https://github.com...

Thank you for saving that, pirate niki! I think i saved a copy as well, right? Yep, here https://archive.is/jcURO I've got lots of these archives of issues and comments lying around. It's good to see more! Btw i knew you'd show up on a comment thread where i posted my stuff. You're like obsessed with my project, right? Why, haha? Maybe because you've got you own archive project, the archive box. "Competition". Hahaha…

I didn't save it, it was picked up by archive.org's own crawler in Nov. Also I think you're way overthinking this, I just saw this because it's a comment thread on a post about ArchiveBox. It's a little weird that you frame it as competition, there are plenty of open source archiving projects, it's not a war. We can be civil, you don't have to mock me or do stuff like blocking me on Github, I have no beef with 22120.

Re: Make Your Own Internet Archive with Archive Box

#76

Earlier quoted context omitted.

Thank you for saving that, pirate niki! I think i saved a copy as well, right? Yep, here https://archive.is/jcURO I've got lots of these archives of issues and comments lying around. It's good to see more! Btw i knew you'd show up on a comment thread where i posted my stuff. You're like obsessed with my project, right? Why, haha? Maybe because you've got you own archive project, the archive box. "Competition". Hahaha…

I didn't save it, it was picked up by archive.org's own crawler in Nov. Also I think you're way overthinking this, I just saw this because it's a comment thread on a post about ArchiveBox. It's a little weird that you frame it as competition, there are plenty of open source archiving projects, it's not a war. We can be civil, you don't have to mock me or do stuff like blocking me on Github, I have no beef with 22120.

You can pretend it's like that, but that's not how it is. I'll reply you tomorrow

Re: Make Your Own Internet Archive with Archive Box

#78

Earlier quoted context omitted.

Yeah, it supports it but there are security considerations if you're doing it for anything more serious than news content. See here: https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overv...

Thanks, much appreciated. This is a very informative set of things to watch out for that I wouldn't have thought of otherwise.

Make sure you read through this section as well to fully understand the security concerns:

https://github.com/ArchiveBox/ArchiveBox#caveats

Re: Make Your Own Internet Archive with Archive Box

#79

Earlier quoted context omitted.

Thank you for saving that, pirate niki! I think i saved a copy as well, right? Yep, here https://archive.is/jcURO I've got lots of these archives of issues and comments lying around. It's good to see more! Btw i knew you'd show up on a comment thread where i posted my stuff. You're like obsessed with my project, right? Why, haha? Maybe because you've got you own archive project, the archive box. "Competition". Hahaha…

I didn't save it, it was picked up by archive.org's own crawler in Nov. Also I think you're way overthinking this, I just saw this because it's a comment thread on a post about ArchiveBox. It's a little weird that you frame it as competition, there are plenty of open source archiving projects, it's not a war. We can be civil, you don't have to mock me or do stuff like blocking me on Github, I have no beef with 22120.

[deleted]

Re: Make Your Own Internet Archive with Archive Box

#80

Earlier quoted context omitted.

Thank you for saving that, pirate niki! I think i saved a copy as well, right? Yep, here https://archive.is/jcURO I've got lots of these archives of issues and comments lying around. It's good to see more! Btw i knew you'd show up on a comment thread where i posted my stuff. You're like obsessed with my project, right? Why, haha? Maybe because you've got you own archive project, the archive box. "Competition". Hahaha…

I didn't save it, it was picked up by archive.org's own crawler in Nov. Also I think you're way overthinking this, I just saw this because it's a comment thread on a post about ArchiveBox. It's a little weird that you frame it as competition, there are plenty of open source archiving projects, it's not a war. We can be civil, you don't have to mock me or do stuff like blocking me on Github, I have no beef with 22120.

[deleted]
Post reply on HN