I'm talking about greater than 5 TB in size. Rclone looks really good because I can just give it a bandwidth limit, point it at google drive and fire and forget. But I'm curious if that is the best way to do this? What does HN think?
Ask HN: What is the current state of the art in BIG (>5TB) cloud backups?
1–10 of 22 posts
Re: Ask HN: What is the current state of the art in BIG (>5TB) cloud backups?
#2Like so many things, it depends-
How quickly do you need to be able to restore? Is it commercial or homelab?
The most cost-effective option by far would be to put a NAS device someplace offsite. You could use tailscale to connect to it remotely.
After that, depending on your access patterns, either a glacier-style s3 service (aws or backblaze/etc), or a rented bare-metal server with big disks some place inexpensive.
Re: Ask HN: What is the current state of the art in BIG (>5TB) cloud backups?
#3This needs more information. 5TB is far from "BIG" when it comes to cloud backups.
You can probably get away with google drive+rclone+borg/restic/whatever, but it will be rather clunky. Backblaze might be a nicer backend to use.
I use rsync.net with borg, but not sure about your budget. Their 1TB lifetime plan is very competitive though.
Re: Ask HN: What is the current state of the art in BIG (>5TB) cloud backups?
#4Like so many things, it depends- How quickly do you need to be able to restore? Is it commercial or homelab? The most cost-effective option by far would be to put a NAS device someplace offsite. You could use tailscale to connect to it remotely. After that, depending on your access patterns, either a glacier-style s3 service (aws or backblaze/etc), or a rented bare-metal server with big disks some place inexpensive.
This is for a "warm" backup as opposed to a hot backup so restoration timeline would be like seven days.
Re: Ask HN: What is the current state of the art in BIG (>5TB) cloud backups?
#55 TB? I don't know how to count that low.
Re: Ask HN: What is the current state of the art in BIG (>5TB) cloud backups?
#65 TB? I don't know how to count that low.
It's just bigger than any amount I've ever dealt with in my whole life (I'm 30) and also it's hard to find solutions to manage it without running into bandwidth caps and also things are running for a very long time on the client side: days or weeks.
Re: Ask HN: What is the current state of the art in BIG (>5TB) cloud backups?
#7Why are you choosing to use the cloud instead of spinning rust under your control?
Or to put it another way, why is state of the art important?
Re: Ask HN: What is the current state of the art in BIG (>5TB) cloud backups?
#8Why are you choosing to use the cloud instead of spinning rust under your control? Or to put it another way, why is state of the art important?
Because you want an offsite backup of your local backups.
Re: Ask HN: What is the current state of the art in BIG (>5TB) cloud backups?
#9Why are you choosing to use the cloud instead of spinning rust under your control? Or to put it another way, why is state of the art important?
I need to know what people are doing recently because most of the documentation I'm finding online is from 3-5 years ago and I want the most up-to-date information.
Re: Ask HN: What is the current state of the art in BIG (>5TB) cloud backups?
#10If it’s important just use b2 or hetzner storage box. Use restic or rustic for backup and dedupe and encryption. I run this setup for home and work and we’re doing this on 10tb+.