Live data from Hacker News

Amazon Quantum Ledger Database

aws.amazon.com

111–120 of 183 posts

Re: Amazon Quantum Ledger Database

#111

Earlier quoted context omitted.

Your data modelling has to be GDPR compliant not your database.

How do you delete user data from an immutable store? You get into cryptography at that point and then some edge cases make it not so simple.

If you tie a user to a uuid separately from where you are logging the transactions, you can nullify the existing UUID link to the given user and be in full compliance with GDPR.

Re: Amazon Quantum Ledger Database

#112
Under the guise of "immutable ledger" (basically just a honest scout promise by Amazon) Amazon gets into industrial provenance business. Genius. No sarcasm. Like that satellite ground station business yesterday. Basically "own the platform of the future" strategy the same way like spinning up the AWS 10 years ago. While companies like Google struggle to find any new business, Bezos just "printing" it non-stop (does he have a separate area in his brain labeled "Bezos X" ?).

Re: Amazon Quantum Ledger Database

#113
post #68

Earlier quoted context omitted.

You can use cryptoshredding: have an encryption key for each user (stored outside of this ledger) and encrypt all PII with that key. Throw away the key if the user wants you to delete their data.

But then you must also plan for what happens when that encryption is broken. So I think you also need to control and protect your storage in order to make that a safe strategy. The more I think about these things, the more I distrust cloud providers, and want my own hardware. Do you really trust these companies enough to hand them the keys to all your data? Is there really any way to provide secrets to your app witho…

If you only care about legal liability, cryptoshredding is generally recognized as an effective measure for secure deletion.

Re: Amazon Quantum Ledger Database

#115
post #70

Uhm... If some of my data is stored in one instance of that database and I then ask the owning company to delete such data in accordance to , say, GDPR... What happens ?

You delete it. You think there won't be a "I'm pretty sure I want to delete this?" option? you probably have to explicitly go out of your way to do it since the point is not to delete data.

There's probably also an option for not keeping history for data that it doesn't make sense to have history for.

Re: Amazon Quantum Ledger Database

#116
post #74
post #68

Earlier quoted context omitted.

You can use cryptoshredding: have an encryption key for each user (stored outside of this ledger) and encrypt all PII with that key. Throw away the key if the user wants you to delete their data.

What if the key leaked before you have thrown it away?

Probably the same as when the actual data is leaked.

Re: Amazon Quantum Ledger Database

#117
post #58

Is it possible to comply with GDPR while using this to store data? Given that it operates like an append-only log, is it possible to actually remove data to comply with a GDPR request?

It's easy enough to store sensitive data externally (e.g., in a key value store) and simply store a reference to the data along with its hash in the ledger. When data needs to be removed, delete the data from your KV store and add an entry to the ledger noting that it was removed.

But you probably wouldn't store sensitive user data in this kind of database anyway. Not ever use case is well-suited for a ledger like this. In most applications, this would be pointless overhead.

Re: Amazon Quantum Ledger Database

#118
post #95
post #74

Earlier quoted context omitted.

What if the key leaked before you have thrown it away?

That's a good question! If your keys leaked, you'd probably have to assume you lost all of the data up to that point. To secure the data going forward, you'd need to generate a second key per user for all of the future data. Well, and hopefully shore up the security problems! I agree, though, that an immutable ledger like this complicates things in a way that you-shouldn't-mutate-but-can datastores do not.

I think it's worse than just losing the data. If you operate a public cryptography ledger with users data in EU and do it under some company name, you won't be able to comply with the "right to be forgotten" or how it's called.

I'm currently working on this problem in application to blockchains. The plan ATM is to implement cryptographic snapshots of the data, where the old transactions are erased but their proof is available.

Re: Amazon Quantum Ledger Database

#119
post #68
post #58

Is it possible to comply with GDPR while using this to store data? Given that it operates like an append-only log, is it possible to actually remove data to comply with a GDPR request?

You can use cryptoshredding: have an encryption key for each user (stored outside of this ledger) and encrypt all PII with that key. Throw away the key if the user wants you to delete their data.

key rotation, disclosure, generation, storage, escrow, regulatory jurisdictions - there are a lot more issues than what you mention.
Post reply on HN