Live data from Hacker News

Canon's cloud platform has lost users' files and can't restore them

digitalcameraworld.com

241–250 of 419 posts

Re: Canon's cloud platform has lost users' files and can't restore them

#241
post #36

Everyone should be looking for a backup strategy that involves at least a hot backup and a cold backup, with some sort of offline validation. However this is easier said than done (because now you've to deal with multiple file systems, decisions about cryptography, lack of interest in creating something that you hope you'll never need, and so on). I wish there was a service (and don't tell me about Backblaze because…

I have a multi-dimensional backup strategy, which includes “cloudy” backups of my most important assets, using services like GitHub, local hourly NAS (Synology double-redundant RAID-like) incremental backups of my whole system, and running “hot” backups of my system and development volumes; automatically updated every four hours (or on-demand. It's a bootable CCC clone). I seldom need to use anything more than my “ho…

Yes, backing up photos and videos is hard. However, if you do so professionally, you are probably better off not risking losing data so you should take precautions. If you are a hobbyist, it’s also cheaper for you to do so. The problem is lack of a usable and straight-forward solution, in my point of view.

Re: Canon's cloud platform has lost users' files and can't restore them

#242

This sounds to me like the classic “replication is not backups” situation where (at best) all of the user files were stored in RAID array someplace and that is what the malware ate. If there had been actual backups and effective backups then it should have been trivial to restore non-corrupted files. It also sounds like someone made the decision not to backup the raw images because they were “big” - that is actually…

replication is not backup and backups need to be replicated too.. and it goes on and on..

Re: Canon's cloud platform has lost users' files and can't restore them

#243
post #232

Earlier quoted context omitted.

What’s the difference between replication and backups? Is the distinction that backups must be stored on separate infrastructure, whereas replication might still be 1 or 2 points of failure?

Replication is about having data level redundancy to protect from drive failure. Backups are about having point in time snapshots of the system state, and about having them tiered from a location perspective. The 3-2-1[1] principle says to have 3 total copies, 2 of which are local but on different devices, and 1 of which is offsite. This gives you tiers of recoverability. It’s important from a backup perspective that…

I would add to that, that the offsite one should also be offline.

Re: Canon's cloud platform has lost users' files and can't restore them

#244
post #49

This is all because someone thought it would be “easy” to add a stream of recurring revenue for cloud photo storage but didn’t take the time to design the service from a technical perspective to be resilient enough to not crash and burn.

This can be just calculated risk. Incredible damage for some users can be negligible damage to the company. In this case just 10TB of data was lost, so maybe thousands of users for the long term storage option. Losing customer data has potential for big reputation or brand damage, but surprisingly often the damage is relatively small. Putting in too much effort when potential damage to business is minimal may not be…

[deleted]

Re: Canon's cloud platform has lost users' files and can't restore them

#245
post #224

Earlier quoted context omitted.

There is no such thing as lack of risk in this world. When a restaurant takes your reservation for Friday night, there's a 0.00001% (or so) risk that they will burn down on Thursday or that half the staff will get heart attacks or something. Should they not do reservations at all?

If they don't have a working smoke alarm, or are storing flammable materials over the burner, or don't have enough emergency exits then no, they should not do reservations at all. It seems Canon did not have a backup, they had replication of data. If you are storing data for money, then this is a professionally negligent behavior. Not being able to prepare for everything is not an valid excuse to not prepare for what…

What does adherence to fire code have anything to do with taking reservations?

Also, reservations are free. It's not reasonable to expect restaurants to do anything and everything to honor 100% of reservations when many customers never show up for them and don't have any skin in the game anyway. Whatever point is trying to be made here is going out the window thanks to the "zero 9" nature of restaurant reservations. (Yes, not even 90% of restaurant reservations end up turning into actual paying tables.)

Re: Canon's cloud platform has lost users' files and can't restore them

#246

Earlier quoted context omitted.

This comment reads as "This is normal; nothing to see here move along". Which is more of an indictment on the state of things than on the comment itself. If you can't protect people's shit, don't offer to hold onto it for money!

"If you can't protect people's shit, don't offer to hold onto it for money!" If you can't sell a reliable car, don't make one? Products fail sometimes and we in the tech-sphere get to laugh about it. No such thing as 100% failure proof. Customers that paid for the service would be angry but no doubt, they'd get their money back. Yes they might have lost more, but that's the business sometimes.

[deleted]

Re: Canon's cloud platform has lost users' files and can't restore them

#247

This sounds to me like the classic “replication is not backups” situation where (at best) all of the user files were stored in RAID array someplace and that is what the malware ate. If there had been actual backups and effective backups then it should have been trivial to restore non-corrupted files. It also sounds like someone made the decision not to backup the raw images because they were “big” - that is actually…

What’s the difference between replication and backups? Is the distinction that backups must be stored on separate infrastructure, whereas replication might still be 1 or 2 points of failure?

If your drive fails (or a single computer fails) replication saves your data, and keeps things running seamlessly.

If you `sudo rm -rf / --no-preserve-root` your drive, replication deletes everything, while backups let you restore to the last time you took a backup.

Re: Canon's cloud platform has lost users' files and can't restore them

#248

Earlier quoted context omitted.

This comment reads as "This is normal; nothing to see here move along". Which is more of an indictment on the state of things than on the comment itself. If you can't protect people's shit, don't offer to hold onto it for money!

No, that comment sounds like the insurance job described in Fight Club[1] > Narrator: A new car built by my company leaves somewhere traveling at 60 mph. The rear differential locks up. The car crashes and burns with everyone trapped inside. Now, should we initiate a recall? Take the number of vehicles in the field, A, multiply by the probable rate of failure, B, multiply by the average out-of-court settlement, C. A…

A farmer's donkey dies. His son gets an idea on how to make some money.

Sometime later he turns up at dinner with $200. "Where did you get that money?" His father asks.

"I sold raffle tickets for the donkey" his son replied.

"What?!?" Shouts his father. "You can't sell raffle tickets for a donkey that you know has already died! Weren't people mad?"

"Just the guy who won" said the son, "so I gave him his money back."

Re: Canon's cloud platform has lost users' files and can't restore them

#249
post #192
post #94

Earlier quoted context omitted.

They obviously do have _some_ backups (since were able to restore all videos and all photos - but not all photos at the original resolution). In the end it's all a tradeoff... ignoring cost, we all know what to do to get pretty safe storage. But how much are you really willing to pay, per month, for that safety?

> since were able to restore all videos and all photos - but not all photos at the original resolution "Canon has said that there is no technical measure to restore lost video files, but that photo files can be restored – albeit not at their original resolution."

Ah I somehow misread that, thought they can restore videos but for photos they don't have the original resolution.

Re: Canon's cloud platform has lost users' files and can't restore them

#250
post #225

Earlier quoted context omitted.

There is a difference between being critical of something and hating it. And if you want to change a system, there are not many ways to do so without interacting with it. Say you happen to be born into a communist regime but dislike communism. Getting out of it might not be feasible for any reason ranging from not being allowed to, not having the means, to not wanting to leave your community behind. No matter if you…

> There is a difference between being critical of something and hating it. The original comment said “hate” not “is bad”; probably the source of a lot of the confusion in this thread lol. > If you want to destroy capitalism, hacker news is probably not the most promising place to start. If your goal is to tweak it I actually think it is. Idunno, even just calling it “bad” seems to imply that there are better things,…

> The original comment said “hate” not “is bad”

I read that as a somewhat hyperbolic expression of dislike, like "I hate spinach" – strong dislike, but not actual hatred. I might actually say that I hate spinach, because I really can't stand the taste, but I don't feel hatred towards it. But yes, I guess that may have caused some misunderstanding.

> just calling it “bad” seems to imply that there are better things, which is not really a statement about “tweaking” anything.

Like an improved version of that thing. Case in point: My last batch of salsa verde was bad, too few tomatillos, too much seasoning, so I'll tweak the recipe with a note to make sure the rations there don't skew that way next time. I don't have to give up on my recipe for good, or on salsa verde for good, or on food for good.

> A statement in favour of tweaking capitalism would be something like “capitalism on its own can not reliably produce moral goods”.

There are different variantions of capitalism implemented around the world right now; there are parameters that can be tweaked, like with the German "soziale Marktwirtschaft", which was a version of a capitalist market-based economy with socialist elements. Even in the US, the flavor of capitalism in Roosevelt's day was quite a bit different from the one currently in place, I believe.

Post reply on HN