Live data from Hacker News

Show HN: CLI tool for saving web pages as a single file

github.com

61–70 of 216 posts

Re: Show HN: CLI tool for saving web pages as a single file

#61
One thing I always wonder when I see native software posted here:

How do you guys handle the security aspect of executing stuff like this on your machines?

Skimming the repo it has about a thousand lines of code and a bunch of dependencies with hundreds of sub-dependencies. Do you read all that code and evaluate the reputation of all dependencies?

Do you execute it in a sandboxed environment?

Do you just hope for the best like in the good old times of the C64?

Re: Show HN: CLI tool for saving web pages as a single file

#64

I really like this concept, and I've been using an npm package called inliner which does this too: https://www.npmjs.com/package/inliner I'm glad there's more people taking a look at the use case, and I'd be interested to see a list of similar solutions. If you combine this with Chrome's headless mode, you can prerender many pages that use JavaScript to perform the initial render, and then once you're done send it to…

Thanks, I'll look into making it work with pipes or some other way to interact with headless browsers.

Reach out when you do so, I've a similar use case here !

Re: Show HN: CLI tool for saving web pages as a single file

#65

One thing I always wonder when I see native software posted here: How do you guys handle the security aspect of executing stuff like this on your machines? Skimming the repo it has about a thousand lines of code and a bunch of dependencies with hundreds of sub-dependencies. Do you read all that code and evaluate the reputation of all dependencies? Do you execute it in a sandboxed environment? Do you just hope for the…

We may semi-trust our package and repo systems. This tool is readily available through AUR on my Arch machine, I see. Or we may go the whole hog and actually have a peek through the source.

Re: Show HN: CLI tool for saving web pages as a single file

#67

One thing I always wonder when I see native software posted here: How do you guys handle the security aspect of executing stuff like this on your machines? Skimming the repo it has about a thousand lines of code and a bunch of dependencies with hundreds of sub-dependencies. Do you read all that code and evaluate the reputation of all dependencies? Do you execute it in a sandboxed environment? Do you just hope for the…

It's a valid question. It seems to me users tend to trust things which have certain level of popularity and reputation associated with them.

I personally prefer to hope for the worst. This way when nothing happens I feel extra lucky, and if bad things do happen, I feel proud of being ready for it.

Re: Show HN: CLI tool for saving web pages as a single file

#68
post #11

I think it would be way better to explain in the repository: - how do you handle images? - does it handle embedded videos? - does it handle JS? to what extent? - does it handle lazily loaded assets (i.e. images that load only when you scroll down, or JS that loads 3 seconds later after the page is loaded) In general, how does this work? The current readme doesn't do a decent job explaining what the tool exactly is. F…

It can’t handle JS completely because we can’t predict a programs behaviour using static analysis. See Halting Problem for example.

Re: Show HN: CLI tool for saving web pages as a single file

#69
Nice. I can see some automated uses for this. In ordinary browsing, am currently using a Firefox addon called SingleFile which works surprisingly well. Stuffs everything into (surprise, surprise) one huge single file - html with embedded data, so compatible everywhere.

Re: Show HN: CLI tool for saving web pages as a single file

#70

One thing I always wonder when I see native software posted here: How do you guys handle the security aspect of executing stuff like this on your machines? Skimming the repo it has about a thousand lines of code and a bunch of dependencies with hundreds of sub-dependencies. Do you read all that code and evaluate the reputation of all dependencies? Do you execute it in a sandboxed environment? Do you just hope for the…

It takes 2 commandes to create a new LXC container and ssh into it, then I install the software inside the container
Post reply on HN