Live data from Hacker News

Show HN: Pocket Stream Archive – A personal Way-Back Machine

github.com

11–20 of 70 posts

Re: Show HN: Pocket Stream Archive – A personal Way-Back Machine

#11
This is cool.

Could you add an option to either add tagging, or separate the tagged items into folders?

e.g. "programming/", "docker/" etc, I often find myself digging through my Pocket archive trying to find that one article I found 6 months ago and it gets incredibly annoying

Re: Show HN: Pocket Stream Archive – A personal Way-Back Machine

#12

This is cool. Could you add an option to either add tagging, or separate the tagged items into folders? e.g. "programming/", "docker/" etc, I often find myself digging through my Pocket archive trying to find that one article I found 6 months ago and it gets incredibly annoying

I like having the sites by timestamp because they're guaranteed to be unique, and it makes traversing them easy. I'd be happy to add a tag column to the index though, which you could use with Ctrl+F to find articles. https://github.com/pirate/pocket-archive-stream/issues/1

Re: Show HN: Pocket Stream Archive – A personal Way-Back Machine

#14
post #3

Now if only Chromium could learn to write WARC archives, then it would be on par! :) Great project!

I've been thinking along those very same lines for a long time (this project makes me wish for more free time).

I have half a mind to fork this and add something like https://github.com/internetarchive/warcprox, or at the very least walk through the generated HTML and brute-force inline all assets as a first pass :)

Re: Show HN: Pocket Stream Archive – A personal Way-Back Machine

#15
post #4

Earlier quoted context omitted.

Can one automate extensions through headless chrome ? then you might be able to trigger WarCreate instead (It will be more efficient to run the pocket export urls through WAIL though - this should give you the warcs you want)

Yeah, you can use the remote debugger protocol to make JS calls in the context of the page. https://chromedevtools.github.io/devtools-protocol/ Not sure if it's worth including in my script though, since WARCs aren't easily browseable (correct me if I'm wrong).

Well, no, but on a Mac .webarchives are Spotlight indexable and make for a nice single-file archiving approach, and I might actually have some old code that tries to convert between the two...

Re: Show HN: Pocket Stream Archive – A personal Way-Back Machine

#16
post #4

Earlier quoted context omitted.

Can one automate extensions through headless chrome ? then you might be able to trigger WarCreate instead (It will be more efficient to run the pocket export urls through WAIL though - this should give you the warcs you want)

Yeah, you can use the remote debugger protocol to make JS calls in the context of the page. https://chromedevtools.github.io/devtools-protocol/ Not sure if it's worth including in my script though, since WARCs aren't easily browseable (correct me if I'm wrong).

Oh, and kudos for the awesome GitHub username :)

Re: Show HN: Pocket Stream Archive – A personal Way-Back Machine

#17
post #15

Earlier quoted context omitted.

Yeah, you can use the remote debugger protocol to make JS calls in the context of the page. https://chromedevtools.github.io/devtools-protocol/ Not sure if it's worth including in my script though, since WARCs aren't easily browseable (correct me if I'm wrong).

Well, no, but on a Mac .webarchives are Spotlight indexable and make for a nice single-file archiving approach, and I might actually have some old code that tries to convert between the two...

Oh sweet, that's pretty nice.

Re: Show HN: Pocket Stream Archive – A personal Way-Back Machine

#20
post #15

Earlier quoted context omitted.

Well, no, but on a Mac .webarchives are Spotlight indexable and make for a nice single-file archiving approach, and I might actually have some old code that tries to convert between the two...

Oh sweet, that's pretty nice.

Also, I've been hacking away at http://github.com/rcarmo/newsfeed-corpus for a bit. Hadn't thought of doing archival on everything, but having this tied in seems like a logical step ;)
Post reply on HN