Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Pocket Stream Archive – A personal Way-Back Machine

github.com

Post reply on HN
Print view View original

1–10 of 70 posts

Re: Show HN: Pocket Stream Archive – A personal Way-Back Machine

#4

Post by motdiem »

anc84 wrote: post #3

Now if only Chromium could learn to write WARC archives, then it would be on par! :) Great project!

Can one automate extensions through headless chrome ? then you might be able to trigger WarCreate instead (It will be more efficient to run the pocket export urls through WAIL though - this should give you the warcs you want)

Re: Show HN: Pocket Stream Archive – A personal Way-Back Machine

#5

Post by avian »

What version of Google Chrome do you need for the PDF export to work? I tried it on 58.0.3029.96 (Linux) and this does nothing (no error messages, it just quits without writing any files):

$ google-chrome --headless --disable-gpu --print-to-pdf 'http://example.com'

Edit: I'm completely baffled that such widely used software as Google Chrome can have this written in the man page: "Google Chrome has hundreds of undocumented command-line flags that are added and removed at the whim of the developers."

Re: Show HN: Pocket Stream Archive – A personal Way-Back Machine

#6

Post by nikisweeting »

avian wrote: post #5

What version of Google Chrome do you need for the PDF export to work? I tried it on 58.0.3029.96 (Linux) and this does nothing (no error messages, it just quits without writing any files): $ google-chrome --headless --disable-gpu --print-to-pdf ' http://example.com' Edit: I'm completely baffled that such widely used software as Google Chrome can have this written in the man page: "Google Chrome has hundreds of undocu…

59 or later, --headless is a brand new feature. apt-get install google-chrome-canary.

https://developers.google.com/web/updates/2017/04/headless-c...

Re: Show HN: Pocket Stream Archive – A personal Way-Back Machine

#8

Post by nikisweeting »

motdiem wrote: post #4
anc84 wrote: post #3

Now if only Chromium could learn to write WARC archives, then it would be on par! :) Great project!

Can one automate extensions through headless chrome ? then you might be able to trigger WarCreate instead (It will be more efficient to run the pocket export urls through WAIL though - this should give you the warcs you want)

Yeah, you can use the remote debugger protocol to make JS calls in the context of the page. https://chromedevtools.github.io/devtools-protocol/

Not sure if it's worth including in my script though, since WARCs aren't easily browseable (correct me if I'm wrong).

Re: Show HN: Pocket Stream Archive – A personal Way-Back Machine

#9

Post by nikisweeting »

ents wrote: post #7

Would be cool to see this for Instapaper or Pinboard

My script should work with very minimal tweaking if you can get a list of urls + titles from those services.

Just one line of regex changes probably: https://github.com/pirate/pocket-archive-stream/blob/master/...

Post reply on HN