Has GDPR compliance gone too far?
No. Losing data is just as bad from a GDPR perspective.
Oh, really? Can you actually be fined for destroying disks containing customer information?
Canon's cloud platform has lost users' files and can't restore them
31–40 of 419 posts
Re: Canon's cloud platform has lost users' files and can't restore them
#32This is all because someone thought it would be “easy” to add a stream of recurring revenue for cloud photo storage but didn’t take the time to design the service from a technical perspective to be resilient enough to not crash and burn.
My two cents is going to be that the ad tech MacBook deleted the old S3 bucket for mockup but it wasn’t a mockup at that point
Re: Canon's cloud platform has lost users' files and can't restore them
#33Earlier quoted context omitted.
Store data and keys seperately. The set of keys for all your customers should be only a few megabytes, so is much much easier to back up more frequently and more copies of. It's also easier to have a "we do daily backups and delete any backups after 21 days" policy.
Storing names separately can help but the subset of data you have a legitimate legal reason to "refuse to forget" can change faster than you would want to rewrite your backups(well, nobody wants to rewrite backups, but you get what I mean)
You need to denormalize the non-forgettable information. This way you don't have to worry about what you can delete or not.
Store Invoices, billing, etc, separately. These also usually have a fixed pre-determined retaining policy time. Past that time? Anonymize/aggregate or just delete it.
Re: Canon's cloud platform has lost users' files and can't restore them
#34This is all because someone thought it would be “easy” to add a stream of recurring revenue for cloud photo storage but didn’t take the time to design the service from a technical perspective to be resilient enough to not crash and burn.
My two cents is going to be that the ad tech MacBook deleted the old S3 bucket for mockup but it wasn’t a mockup at that point
What do you mean? The article says it was a software bug that accidentally deleted both short-term and long-term storage, while it should have been only short-term.
Re: Canon's cloud platform has lost users' files and can't restore them
#35This is all because someone thought it would be “easy” to add a stream of recurring revenue for cloud photo storage but didn’t take the time to design the service from a technical perspective to be resilient enough to not crash and burn.
More likely than not some manager decided all those extra nines weren't really necessary.
[deleted]
Re: Canon's cloud platform has lost users' files and can't restore them
#36Everyone should be looking for a backup strategy that involves at least a hot backup and a cold backup, with some sort of offline validation. However this is easier said than done (because now you've to deal with multiple file systems, decisions about cryptography, lack of interest in creating something that you hope you'll never need, and so on). I wish there was a service (and don't tell me about Backblaze because it's incomplete and doesn't work that well - from my own experience) that would do all these things for you in a reliable and trustworthy way (including giving you snapshots in physical media from time to time - delivering to different addresses, possibly in different jurisdictions, and so on).
Re: Canon's cloud platform has lost users' files and can't restore them
#37Has GDPR compliance gone too far?
The article doesn't mention GDPR.
Re: Canon's cloud platform has lost users' files and can't restore them
#38Lesson for those designing cold-storage solutions--design your system, as much as reasonable, to not support deletion operations. The reason why files get lost is usually due to software bugs, bad configurations, and operator errors. Design your system to protect against these things.
The problem with that is that under GDPR you have to support full deletion of an user's data.
Re: Canon's cloud platform has lost users' files and can't restore them
#39Re: Canon's cloud platform has lost users' files and can't restore them
#40Earlier quoted context omitted.
Storing names separately can help but the subset of data you have a legitimate legal reason to "refuse to forget" can change faster than you would want to rewrite your backups(well, nobody wants to rewrite backups, but you get what I mean)
You need to denormalize the non-forgettable information. This way you don't have to worry about what you can delete or not. Store Invoices, billing, etc, separately. These also usually have a fixed pre-determined retaining policy time. Past that time? Anonymize/aggregate or just delete it.
Legislation can change and what you once thought to be forgettable becomes suddenly not.