Live data from Hacker News

Arq 4 is out – Mac backup to S3/Glacier

haystacksoftware.com

61–70 of 103 posts

Re: Arq 4 is out – Mac backup to S3/Glacier

#61

Wonderful piece of software - highly recommended. Awesome upgrade also, have been waiting for S3 alternatives for a long time. It's unfortunate a few things appear to be backwards - why can you include wifi APs, yet not exclude them - despite the example suggesting you exclude from tethered devices. Likewise, why can you email on success, but not failure.

Seriously? There's still no way to get notified if a backup fails?

Re: Arq 4 is out – Mac backup to S3/Glacier

#62
Can someone using S3 Glacier as a backup destination please provide some concrete costs? Even if no retrieval is involved, I'd just love to see: "I pay $XYZ and am backing up ###GB worth of data."

I see the calculator floating around in the comments, but it's not formatted in a backup-friendly fashion / use case (ie. set storage size with XYZ% churn for changed files, or continuously expanding snapshots with aged snapshot deletion).

I've always been curious for usage for backup storage. The costs for retrieval are expensive enough (in the time frames I'd care to see for a personal computer) that I think I'll still avoid that aspect for the time being.

Re: Arq 4 is out – Mac backup to S3/Glacier

#63

Can someone using S3 Glacier as a backup destination please provide some concrete costs? Even if no retrieval is involved, I'd just love to see: "I pay $XYZ and am backing up ###GB worth of data." I see the calculator floating around in the comments, but it's not formatted in a backup-friendly fashion / use case (ie. set storage size with XYZ% churn for changed files, or continuously expanding snapshots with aged sna…

It's cheap until you have to grab a bunch of stuff back all at once. Then they have you by the short hairs.

Re: Arq 4 is out – Mac backup to S3/Glacier

#64

Am I the only one that would like to be able to setup a time range when it's allowed to use my bandwidth? I'm traveling in hotels with shitty wifi most of the time. It's hard enough to browse so I'd really only like to backup while I'm sleeping. Also, in the interest of not hogging all the bandwidth I'd like it to stop by say 6am so that as guests are waking up they can use the bad internet.

> Am I the only one that would like to be able to setup a time range when it's allowed to use my bandwidth?

You can. After you setup a target open the Preferences window. Select the target therein and click the "Edit..." button.

The dialog that follows has an option to "Pause between [00:00] and [00:00]", where [00:00] is a drop-down which lets you pick the top of any hour of the day.

Re: Arq 4 is out – Mac backup to S3/Glacier

#65
post #31

Earlier quoted context omitted.

Not if you're willing to wait a few hours - a delay of the same or smaller order of magnitude as the transfer is going to take anyway. For example, suppose you're restoring 50 GB. If you want to start the retrieval 4 hours from now (the minimum), you'll pay $97. If you're willing to wait 10 hours, that drops to $43. 20, $25. 40, $16. Goes down to $7 at the limit. You can play with the cost at http://liangzan.net/aws-…

For me, the far more likely case would be 500GB, kept for a year. Even with 1000 hours (more than a month!!) for a restore, I'd still have to pay $125. CrashPlan lets me do this for free, and allows me arbitrary access to my backed up data to boot. It just seems like a better deal, unless you're really worried about data corruption in the cloud.

It's the same price for ~72h retrieval...

Re: Arq 4 is out – Mac backup to S3/Glacier

#66
As always, we're very happy to see that in addition to S3/Glacier/DreamCloudStartupOfTheWeek, Arq supports plain old SFTP.

This means that, of course, it works perfectly with rsync.net and that we have yet another chance to offer the HN readers discount, which you may email us to find out about.

Re: Arq 4 is out – Mac backup to S3/Glacier

#67

I love the addition of SFTP, and I hope to buy the update soon. Can anyone recommend a SFTP backup provider? My Arq backups are designed to be worst-case. I have other, local backup options in case of failure. I was using Glacier, but I ran into Arq3 sync problems and I need to re-upload all my data. Glacier is very slow from where I live. I assume SFTP will be a bit faster.

I'm not a customer anymore, but was very happy when I was. rsync.net is the perfect service for this.

arq (or any SFTP based client, including sshfs) will work perfectly with rsync.net.

The new-user-HN-discount is 10c per GB, per month, and there are no other (traffic/bandwidth/usage) costs. Our platform is ZFS and there are 7 daily snapshots for free.

We would be happy to serve you, as we've been serving thousands of users since 2001.

Re: Arq 4 is out – Mac backup to S3/Glacier

#68
post #65

Earlier quoted context omitted.

For me, the far more likely case would be 500GB, kept for a year. Even with 1000 hours (more than a month!!) for a restore, I'd still have to pay $125. CrashPlan lets me do this for free, and allows me arbitrary access to my backed up data to boot. It just seems like a better deal, unless you're really worried about data corruption in the cloud.

It's the same price for ~72h retrieval...

Still, it means your monthly price isn't actually what it seems. With 72 hour retrieval, you'll be paying about $14 a month, compared to CrashPlan's $5. And what if you need the data earlier? If you have bad luck and your hard drive crashes a month after you make your backup, you'll end up paying about $100 a month, at least for that month. CrashPlan's flat rate means you don't have to stress out about the fine print.

Re: Arq 4 is out – Mac backup to S3/Glacier

#69
post #8

Earlier quoted context omitted.

If you don't need a turnkey solution I'd just go with a cheap server provider like OVH/Online.net/Hetzner and set up an SFTP server there.

OVH has Swift/OpenStack storage service (hubiC) that makes Glacier look insanely expensive if we're talking about at least about 1TiB+ of backups. Can't tell anything about their reliability, though.

Doesn't seem like hubiC exposes a truly S3-compatible API, which is sad given that it seems to be based on OpenStack Swift.

Re: Arq 4 is out – Mac backup to S3/Glacier

#70
post #13

Earlier quoted context omitted.

Do you mind elaborating what your total backup solution is? I've been looking at Arq but am not aware of what it does not do and what I would need to fill in the gaps. Currently I rely on time machine backing up to three different drives and keeping one of those drives in the office.

I will ignore what I do for server backups, and I will focus on my MacBook. I run my web development business and my personal life off of this system. The software I use: CrashPlan, Arq, DropBox, Carbon Copy Cloner. CrashPlan: I have backing up my data, configuration /Users, /Library. I have a bunch of regex restrictions to not backup various files such as caches, VMWare images, etc. Crashplan backups up to their clo…

> Currently, the biggest pain point for me in backups is VMWare images. I currently have 4 Linux and 3 Windows images on this system, and they can cause a huge amount of data needing to be backed up every time they are used.

This is where a sector-by-sector backup program shines.

I don't know what to recommend on the Mac, but on Windows, ShadowProtect is pretty wonderful. It backs up only changed sectors - update 10MB in a 10GB file and it only copies that 10MB - and it's insanely fast.

Even with a file-by-file backup, one thing you can do for VMware images is to take a snapshot. After you take a snapshot, further changes to the VM don't go into the large .vmdk file you just snapshotted, they go into a new, potentially much smaller .vmdk file, so your next incremental backups may be much smaller.

Post reply on HN