Show HN: Web Page Archiver

#1

Post by 29J » Tue, Jun 27, 2017, 3:25 PM UTC

Show HN: Web Page Archiver
hn2017.ddns.net

Re: Show HN: Web Page Archiver

#2

Post by 29J » Tue, Jun 27, 2017, 3:25 PM UTC

I made this prototype in response to a post I saw at:

https://www.demandrush.com/problems/api-save-files-url

but never heard a peep back from demandrush. Before I shut this web-service down, does anyone here think anything of it?

It's trivial to modify it to send you your web page snapshots via email or whatever. As it happens, the MHTML format is especially suited to email.

Re: Show HN: Web Page Archiver

#3

Post by johnmurch » Tue, Jun 27, 2017, 4:57 PM UTC

29J wrote: post #2

I made this prototype in response to a post I saw at: https://www.demandrush.com/problems/api-save-files-url but never heard a peep back from demandrush. Before I shut this web-service down, does anyone here think anything of it? It's trivial to modify it to send you your web page snapshots via email or whatever. As it happens, the MHTML format is especially suited to email.

Nice work, but if a site uses @import or use javascript to render elements, you will miss out on these elements. I would imagine you would need to use headless chrome or something like phantomjs to be able to download all css/images/etc. as mentioned.

I could be wrong, but that was what I was thinking when I read it.

Re: Show HN: Web Page Archiver

#4

Post by 29J » Tue, Jun 27, 2017, 5:33 PM UTC

johnmurch wrote: post #3

29J wrote: post #2

I made this prototype in response to a post I saw at: https://www.demandrush.com/problems/api-save-files-url but never heard a peep back from demandrush. Before I shut this web-service down, does anyone here think anything of it? It's trivial to modify it to send you your web page snapshots via email or whatever. As it happens, the MHTML format is especially suited to email.

Nice work, but if a site uses @import or use javascript to render elements, you will miss out on these elements. I would imagine you would need to use headless chrome or something like phantomjs to be able to download all css/images/etc. as mentioned. I could be wrong, but that was what I was thinking when I read it.

Thanks for checking it out. You're right. I do exactly what you describe in order to handle such cases.