Live data from Hacker News

Backblaze has stopped backing up OneDrive and Dropbox folders and maybe others

rareese.com

701–710 of 716 posts

Re: Backblaze has stopped backing up OneDrive and Dropbox folders and maybe others

#701
This is at the core an issue with how file-sync is being done now versus in the past.

If you have a folder shared with 10 people, most likely only a few files will be accessed by others and the rest is dormant on all but one machine. Downloading and storing all these files is an expense in transfer fees and to some extent a waste of local disk space.

For that reason, cloud sync tools no longer copy everything up front, but transfer on-demand. Most tools have an option where you can choose "Make available offline" that will make a specific folder always synced.

That said, silently excluding a folder is very problematic, even if there is a good reason for it.

I work on the open-source Duplicati backup tool (https://github.com/duplicati/duplicati) and we take special care to not silently skip things as this is likely to cause problems when you want to restore later. For instance, you will get a lot of warnings if you try to make a backup of a cloud-synced folder, as the cloud-sync cannot keep up with the speed of the backup.

If you like the pricing of B2 but not the backup tool, you can use a B2 bucket (pay per usage, not flat rate) and have Duplicati back up to the bucket.

Re: Backblaze has stopped backing up OneDrive and Dropbox folders and maybe others

#702
post #673

Earlier quoted context omitted.

What do you expect to happen when your cloud storage file path is 5000 characters long and your local filesystem only supports a maximum of 4096?

You expect the files to still be accessible using relative paths. What do you expect to happen if your cloud storage file path is 50 characters long and is mounted in a folder which is 4050 characters long when PATH_MAX is 4096? The sync application itself can handle this using openat(2) or similar and should probably be using that regardless to avoid races.

Ah, I forgot that the maximum path length is usually limited by PATH_MAX, it's the path segment that's usually limited by the filesystem.

Point taken, although I still think it's better for cloud storage services to err on the side of compatibility, i.e. what's the lowest common denominator between Linux, macOS, Android, iOS from 10 years ago and Windows 7?

Re: Backblaze has stopped backing up OneDrive and Dropbox folders and maybe others

#703

We are going to drop blackblaze over this We discovered this change recently because my dad was looking for a file that Dropbox accidentally overwrote which at first we said “no problem. This is why we pay for backblaze” We had learned that this policy had changed a few months ago, and we were never notified. File was unrecoverable If anyone at backblaze is reading this, I pay for your product so I can install you on…

Natasha from Backblaze here. This is a situation people rely on backups for, and I can understand how frustrating it is to run into this when you need a restore. I also want to be clear, this wasn’t about saving on storage. It came from cases where backing up cloud-synced folders (like Dropbox) was leading to unreliable or incomplete restores because of how those files are managed under the hood. When Dropbox began u…

If I can make a product suggestion, Backboard has a part of the interface that shows excluded folders. This should explicitly call out the Dropbox folder as being excluded. The software update that removed support for this should’ve included a pop-up that said “Dropbox is no longer being backed up” (though candidly if this pop-up existed on my dad’s machine and he didn’t see it, my mistake).

My frustration stems from paying hundreds of dollars over several years to pay for backup and then silently learning Dropbox was no longer supported when we went to look for it in our backup. We could’ve made other choices about how to store/bavkup our own files with better communication.

Re: Backblaze has stopped backing up OneDrive and Dropbox folders and maybe others

#704
post #410

Earlier quoted context omitted.

Sorry, what are you saying shouldn't be done? Backing up untracked/modified files in a bit repo? Or compressing the .git folder and backing it up as a unit?

> Backing up untracked/modified files in a bit repo? This. It's best to do this in an atomic operation, such as a VSS style snapshot that then is consistent and done with no or paused operations on the files. Something like a zip is generally better because it takes less time on the file system than the upload process typically takes.

I see what you mean, but isn't this an issue with any filesystem backup tool? Or is there something about untracked files in a git workspace that is different, that I'm not seeing?

Re: Backblaze has stopped backing up OneDrive and Dropbox folders and maybe others

#705
post #418

Earlier quoted context omitted.

Same. I lost a lot of photos this way. I've recently moved over to Immich + Borg backup with a 3-2-1 backup between a local synology NAS and BorgBase. Painful lesson, but at least now I feel much more confident. I've even built some end-to-end monitoring with Grafana.

Careful w that Synology NAS, mine's now a brick that may also have led to permanent data loss.

Thanks... hence, 3-2-1 backups with offsite :) appreciate it though. Will definitely be rolling my own NAS in the future, I just needed something easy at the time.

Re: Backblaze has stopped backing up OneDrive and Dropbox folders and maybe others

#706
post #582

Earlier quoted context omitted.

Not what I meant: The other cloud storage services connected to the computer, eg OneDrive. Those files, when they are just stubs. I'm saying that Backblaze could simply not backup stubs, if the person isn't syncing the actual file to their drive. If they are, backblaze should back it up.

The point of the stubs is so you don’t have to know which cloud files are actually on your device at any given moment, because they will be fetched automatically. Marking files as “always local” is a niche feature, and in any case has nothing to do with whether you want those files backed up. To have this thing you’re not supposed to need to worry about affect whether your files got backed up is exactly the problem h…

>The point of the stubs

Of course it is. So *you* don't have to know which cloud files are actually there. Doesn't mean backblaze can't know, and should work within that paradigm rather than not backup anything.

As for your (the user, not necessary you personally) expectation that Backblaze would backup the stubs (im not sure that would really matter, as you said in your own comment) regardless of its stub status, that's unreasonable-- that Backblaze would travers the stubs and... why? temporarily download them, upload to backblaze? That's not what they ever stated would happen and is a big stretch to expect what amounts to the extra service of backing up cloud drives simply because a user decides to have what amounts to a an 'ln ' to to a network drive. The do explicitly exclude that.

What is not reasonable on their part is to change any service at all that had previously been happening, regardless of whether it was or was not within the ToS, and likely contract law wouldn't support a claim on their part that there was an implied contract through ambiguity which courts will typically resolve in favor of an injured party, especially one in a position of lesser power in the relationship. I'm not claiming that's what happened here, my reading of any ToS has the same legitimacy as this comment on that. I'm saying they do claim they'll backup whatever is on the computer and unexcluded. and its wrong as a matter of basic provisioning of service to a customer of what was offered. That's the limit of my claim.

Re: Backblaze has stopped backing up OneDrive and Dropbox folders and maybe others

#707

Earlier quoted context omitted.

It was a bit, but I never found it as bad as Backblaze.

CrashPlan required, if I recall correctly, 1GB of RAM for every 1TB backed up. It got a bit unwieldy after a while, because I have multiple terabytes of photos and videos over many years.

These clients can't be that hard to write, surely?

Re: Backblaze has stopped backing up OneDrive and Dropbox folders and maybe others

#708

We are going to drop blackblaze over this We discovered this change recently because my dad was looking for a file that Dropbox accidentally overwrote which at first we said “no problem. This is why we pay for backblaze” We had learned that this policy had changed a few months ago, and we were never notified. File was unrecoverable If anyone at backblaze is reading this, I pay for your product so I can install you on…

Hello, Jim from Backblaze here. I wanted to offer some insight into what happened with backing up cloud-synced folders. It is true that we recently updated how Backblaze Computer Backup handles cloud-synced folders. This decision was driven by a consistent set of technical issues we were seeing at scale, most of them driven by updates created by third-party sync tools, including unreliable backups and incomplete rest…

>We’ve made targeted investments where we can, for example, adding support for iCloud Drive by working within Apple’s model

Is icloud drive backed up or not? Please be clear. Which versions support this?

https://www.backblaze.com/computer-backup/docs/back-up-iclou... still says that it no longer backs up icloud drive files. Then it gives directions on how to back them up. Which is it?

Also, why did you stop backing up .git folders, sliently?

Re: Backblaze has stopped backing up OneDrive and Dropbox folders and maybe others

#709

Earlier quoted context omitted.

I'm going to drop Backblaze for my entire company over this. I need it to capture local data, even though that local data is getting synced to Google Drive. Where we sync our data really has nothing to do with Backblaze backing up the endpoint. We don't wholly trust sync, that's why we have backup. On my personal Mac I have iCloud Drive syncing my desktop, and a while back iCloud ate a file I was working on. Backblaz…

Natasha from Backblaze here. Just wanted to let you know that we do backup iCloud data, as long as the files are stored locally on your device (not just in iCloud as “optimize storage” / cloud-only files). If iCloud is set to keep full copies on disk, Backblaze will treat those like normal files and back them up. More details here: https://www.backblaze.com/computer-backup/docs/en/back-up-ic... Happy to answer any qu…

At the top of this page:

>NOTE: >iCloud's most recent update prevents Backblaze from backing up files that iCloud synced. >To back up these files, download them to another local location where Backblaze can read them.

So which is it?

Re: Backblaze has stopped backing up OneDrive and Dropbox folders and maybe others

#710
post #671

Earlier quoted context omitted.

We will continue to specialize in filesystem provision, not object storage. However, we do support interoperating with block storage, such as 's5cmd': https://news.ycombinator.com/item?id=44248372 ... and, of course, rclone, which you can invoke remotely, on our end to move data between cloud accounts, etc.

Thank You for that link! > not object storage Happy to email you, if that's better, but is this because of unsustainable competition in the space or the tremendous volatility in consumption that object storage customers bring to the table? I ask because in this current market, I would imagine investing in storage infrastructure is painful, but then I wonder, you are still in the storage infrastructure space anyways,…

Not supporting S3 (and block storage) is not a business decision - it is an ideological decision.

We want to live in a world of UNIX filesystems and we want those to be available in the modern "cloud" ecosystem.

Post reply on HN