Live data from Hacker News

Show HN: Baxx – Unix-friendly backup service

txt.black

181–190 of 203 posts

Re: Show HN: Baxx – Unix-friendly backup service

#181

Earlier quoted context omitted.

This looks good, and competitively priced too! What's the backend cloud storage?

Just guessing here but probably Backblaze b2? It has a similar pricing.

Currently it's on RAID boxes, but I'll move to CephFS soon. The data volume is getting too big to copy it around. Ceph allows you to nicely expand your storage over time and account for some failures on the way.

Borg needs a "smart" backend with a filesystem, so it can't use only object-storage.

Re: Show HN: Baxx – Unix-friendly backup service

#182
post #173

Earlier quoted context omitted.

I'm definitely looking into what I can do as far as getting logs rotated (and thus split) better, but a lot of what I back up are legacy medical systems where making any kind of change is extremely difficult both technically and politically.

A slightly hacky method might be an overlay filesystem (using FUSE or similar) that mirrors the underlying filesystem for small files but represents the larger ones as smaller units (so bigfile becomes bigfile.block0000, bigfile.block0001, ...). That way only the changed block would get transferred if you one-byte change is a modify or append rather than on insert or delete. If the backup service is using file timest…

Dude. That’s more than just “slightly” hacky. Points for the idea though.

Re: Show HN: Baxx – Unix-friendly backup service

#183

(Alternative product recommendation, please downvote/remove if you feel that isn't appropriate) For Unix/Linux backups, may I suggest Borg Backup? It encrypts and does dedupe astonishingly well. It also works over SSH incredibly fast, and restores are via a mounted FUSE filesystem so they're easy to pick and choose what you need. It prunes really well too, and is a single executable so it's easy to distribute via Ans…

For bash scripting: have you seen shellcheck? It's a very solid first-pass for any script, and the codes it emits have excellent documentation: https://www.shellcheck.net/

Re: Show HN: Baxx – Unix-friendly backup service

#184
post #157
post #152

Earlier quoted context omitted.

You can't reasonably expect most people who would register to a service over ssh and make backups with cUrl in a shell script to update their known_hosts file? The instructions on the main page would change from: ssh register@ui.baxx.dev to something like curl https://ui.baxx.dev/ssh_keys -o /tmp/baxx_ssh_keys cat /tmp/baxx_ssh_keys cat /tmp/baxx_ssh_keys >> ~/.ssh/known_hosts rm /tmp/baxx_ssh_keys ssh register@ui.ba…

The author of this service didn't think it important to provide the ssh key and based on the comments in this thread people have already signed up for this service without caring about the key. So yes, I think even people who would use this service mostly can't be bothered to manually update their known_hosts file.

In that sense then I agree with you.

Edit: I thought you meant that, given the command, most would still not do it.

Re: Show HN: Baxx – Unix-friendly backup service

#185
post #182

Earlier quoted context omitted.

A slightly hacky method might be an overlay filesystem (using FUSE or similar) that mirrors the underlying filesystem for small files but represents the larger ones as smaller units (so bigfile becomes bigfile.block0000, bigfile.block0001, ...). That way only the changed block would get transferred if you one-byte change is a modify or append rather than on insert or delete. If the backup service is using file timest…

Dude. That’s more than just “slightly” hacky. Points for the idea though.

Manic me has some wonderful ideas that are simultaneously excellent and terrible. I have to keep a careful eye on him in the day job! One of these days I intend to implement and collect a few of his musings under the banner "the ministry of silly code".

Re: Show HN: Baxx – Unix-friendly backup service

#187
post #23

My key objection is that it doesn't offer any additional value: if you are the sort of customer who would do this, you are also the sort of customer who would implement the same chain of commands to backup to a virtual machine that you owned, eliminating the attractiveness of baxx.dev as a aggregated target. What additional value can you add?

If it can do the “Dropbox thing” and make it seamless, then that’s a definite plus.

Re: Show HN: Baxx – Unix-friendly backup service

#188
post #34

I get that it's probably "trendy" to say you don't have or need a website but with it being so easy to create a static page, I'm failing to understand why you wouldn't just do that, which is already the bare minimum, if you care about your project and want to sell it?

Had he done that I doubt it would have done so well on HN. It’s a differentiation point from yet another bootstrap css SaaS with three tier pricing, faded monotone brand logos and circlular portrait photos of the “team”.

Re: Show HN: Baxx – Unix-friendly backup service

#189
post #96

Earlier quoted context omitted.

In general it is standard to put the unit after the quantity though.

Again, not with currencies in English.

Maybe I should have said "it is commonly standard to put the unit after the quantity". My point is that this format is ubiquitous and that English language formatting of currency values is the outlier. It is not even internally consistent, as this rule only holds for the symbol, not for the ISO code, the full name or for speech.

Re: Show HN: Baxx – Unix-friendly backup service

#190
post #141

(Alternative product recommendation, please downvote/remove if you feel that isn't appropriate) For Unix/Linux backups, may I suggest Borg Backup? It encrypts and does dedupe astonishingly well. It also works over SSH incredibly fast, and restores are via a mounted FUSE filesystem so they're easy to pick and choose what you need. It prunes really well too, and is a single executable so it's easy to distribute via Ans…

I evaluated Borg and Restic and found that both of them fall over once you get to (what I consider to be) production level volumes; in my case that's ~1 PB and in the range of a billion files. Sadly, the only thing I've found so far that works at all at those scales is Bacula, and that is file-based -- i.e., if you have a gigabyte file that changes by one byte, it backs up the whole gigabyte again. Not ideal.

I can't say i've been testing with PB sizes, but for my "meager" 8TB backup, Borg works well. A daily backup & prune operation takes less than 20 minutes.

Restic falls over as soon as you cross 2TB sizes, and prune operations are painfully slow. Backing up 8TB took 4 weeks with Restic, and i gave up waiting for prune to finish. It was crossing the 24 hour mark, making it unsuitable for daily backups.

Post reply on HN