Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Baxx – Unix-friendly backup service

txt.black

Post reply on HN
Print view View original

141–150 of 203 posts

Re: Show HN: Baxx – Unix-friendly backup service

#141

Post by dmd »

bloopernova wrote: post #28

(Alternative product recommendation, please downvote/remove if you feel that isn't appropriate) For Unix/Linux backups, may I suggest Borg Backup? It encrypts and does dedupe astonishingly well. It also works over SSH incredibly fast, and restores are via a mounted FUSE filesystem so they're easy to pick and choose what you need. It prunes really well too, and is a single executable so it's easy to distribute via Ans…

I evaluated Borg and Restic and found that both of them fall over once you get to (what I consider to be) production level volumes; in my case that's ~1 PB and in the range of a billion files.

Sadly, the only thing I've found so far that works at all at those scales is Bacula, and that is file-based -- i.e., if you have a gigabyte file that changes by one byte, it backs up the whole gigabyte again. Not ideal.

Re: Show HN: Baxx – Unix-friendly backup service

#142

Post by UI_at_80x24 »

I want to thank-you for using a good-name for your service.

Too many times some developer will pick a common word to launch their service/product thus making it impossible to search for it.

Your name (a) is a single syllable

(b) almost hints at what it does in the name (Baxxup?)

(c) is not easily confused with other products

(d) Your closest competitor from a google SEO standpoint is a tanning salon (single word google)

Great job! I wish I was creative like that. Usually my crap looks like: sbs (server backup script) Works for me but my co-workers hate me.

Re: Show HN: Baxx – Unix-friendly backup service

#143

Post by ekovarski »

spasche wrote: post #120
garettmd wrote: post #73

Earlier quoted context omitted.

Does anyone know how it compares to Restic? That's what I've been using and have been pretty pleased. It seems like the main difference is that restic supports integrations with other services, whereas Borg seems uses SSH for its connections

One big disadvantage of restic at the moment is that it doesn't do compression ( https://github.com/restic/restic/issues/21 ). I was using restic and switched to borg because of that and could save hundreds of gigabytes.

You can always back up onto a compression enabled file system to further save space + dedupe with rustic.

Borg is a fantastic tool but the time it takes to start and parse the files req on a large system negates the benefits of compression for me unfortunately.

Re: Show HN: Baxx – Unix-friendly backup service

#144

Post by ofrzeta »

dmd wrote: post #141
bloopernova wrote: post #28

(Alternative product recommendation, please downvote/remove if you feel that isn't appropriate) For Unix/Linux backups, may I suggest Borg Backup? It encrypts and does dedupe astonishingly well. It also works over SSH incredibly fast, and restores are via a mounted FUSE filesystem so they're easy to pick and choose what you need. It prunes really well too, and is a single executable so it's easy to distribute via Ans…

I evaluated Borg and Restic and found that both of them fall over once you get to (what I consider to be) production level volumes; in my case that's ~1 PB and in the range of a billion files. Sadly, the only thing I've found so far that works at all at those scales is Bacula, and that is file-based -- i.e., if you have a gigabyte file that changes by one byte, it backs up the whole gigabyte again. Not ideal.

In what way do they fall over? Also, did you file bug requests?

Re: Show HN: Baxx – Unix-friendly backup service

#145

Post by dmd »

ofrzeta wrote: post #144
dmd wrote: post #141

Earlier quoted context omitted.

I evaluated Borg and Restic and found that both of them fall over once you get to (what I consider to be) production level volumes; in my case that's ~1 PB and in the range of a billion files. Sadly, the only thing I've found so far that works at all at those scales is Bacula, and that is file-based -- i.e., if you have a gigabyte file that changes by one byte, it backs up the whole gigabyte again. Not ideal.

In what way do they fall over? Also, did you file bug requests?

They start taking unrealistically large amounts of time to deal with their catalogs. For instance, with a 500 TB dataset, Restic on my (128 GB ram) server took over 4 days to do its prune operation.

Re: Show HN: Baxx – Unix-friendly backup service

#146

Post by linsomniac »

johntash wrote: post #107
garettmd wrote: post #73

Earlier quoted context omitted.

Does anyone know how it compares to Restic? That's what I've been using and have been pretty pleased. It seems like the main difference is that restic supports integrations with other services, whereas Borg seems uses SSH for its connections

I've used both Borg and Restic pretty heavily. I settled on Restic because it was much lighter on resources. A few of the servers I manage have small amounts of ram, but large amounts of data. Borg would often get oom-killed, but Restic wouldn't. Restic also starts uploading changes as soon as it sees them, whereas borg has to scan the entire list of files before it starts uploading changes. Unfortunately for multi-t…

Interesting. I had deployed restic to my fleet of 100 servers around a year ago to backup to a common Backblaze B2 destination, and rolled it back after running into a production service getting OOM killed because of restic memory use.

Re: Show HN: Baxx – Unix-friendly backup service

#148

Post by zulgan »

brg1007 wrote: post #25

".... 750E profit - 50% tax = 375E profit"[1]. 50% Taxes in DE, nice place to do business ... [1] https://github.com/jackdoe/baxx/blob/master/infra-and-pricin...

this is the tax for me in The Netherlands, given i am not a company, so it is normal income tax

Re: Show HN: Baxx – Unix-friendly backup service

#149

Post by metafunctor »

blattimwind wrote: post #126
metafunctor wrote: post #105

Earlier quoted context omitted.

Can you give more details on how the encryption is weak?

https://borgbackup.readthedocs.io/en/stable/internals/securi... > When the above attack model is extended to include multiple clients independently updating the same repository, then Borg fails to provide confidentiality (i.e. guarantees 3) and 4) do not apply any more).

Thanks for pointing this out.

The first entry on the Borg FAQ [1] is “can I backup from multiple servers into a single repository” and the answer is basically “yes, but it might be slow”. Seems to me like it should say “not really, it's insecure and might be slow”, plus the tool should make it clear you're doing something unwise if you try it anyway.

I've always shied away from shared backup repositories anyway, because it usually means data from host A can be read by host B, and that's just not what I usually want. The deployment instructions appear sane to me. [2]

[1] https://borgbackup.readthedocs.io/en/stable/faq.html#can-i-b...

[2] https://borgbackup.readthedocs.io/en/stable/deployment/centr...

Re: Show HN: Baxx – Unix-friendly backup service

#150

Post by zulgan »

alexandernst wrote: post #115

As cool as this could be, this service is not passing any company-grade backup quality requirements. Also, the price is a complete no. Not because 5€/m is much, but because 5€/m can get you hundreds of GBs of storage in AWS Glacier, with contractual guarantees about your data, how it's managed, etc... Basically, this is a toy. Use it as a toy, not as a service where you'd actually put your company files. That said, g…

it is absolutely in alpha stage, and yes please use it as a toy and have fun

in the future my plan is to do 5€/m for 1TB which is pretty much glacier price

Post reply on HN