Live data from Hacker News

Amnesia – High-Accuracy Data Anonymization

amnesia.openaire.eu

1–10 of 99 posts

Re: Amnesia – High-Accuracy Data Anonymization

#4
post #2

Do these methods provide any guarantees or is it assumed that a human reviews the output to verify that it was properly anonymized?

> Data anonymized with Amnesia are statistically guaranteed that they cannot be linked to the original data.

It looks like (from other text on their site) they use variants on k-anonymity. This can prevent re-linking attacks back to the original data, but we've also known for a decade that this isn't especially strong. For example, two independent k-anonymous releases can unique identify everyone in the dataset[0].

[0]: https://dl.acm.org/doi/10.1145/1401890.1401926

Re: Amnesia – High-Accuracy Data Anonymization

#5
Fair warning: anonymization is a hard problem. It is never easy, and you'd be surprised how many bits can leak out of what you thought was properly anonymized data.

If you are using data for test purposes please use generated data, not anonymized data. This has the additional advantage that there is no potential path for live data to end up on a developers machine.

added in edit: And also realize that just using a service such as this or similar actually increases the chances that you are leaking sensitive data, in fact uploading somewhere it is the very best way in which you could ensure that at some point there is a breach. Don't take the 'made easy' line for granted if possible ask the company for their audit reports and what measures they have in place to ensure that your data doesn't end up elsewhere, a company providing such a service or a chunk of software that does this is - of course - a massive target. The only way you would stay away from that extra risk is by running this on your premises on a machine that is not connected directly or indirectly to the outside world.

Re: Amnesia – High-Accuracy Data Anonymization

#6
post #2

Do these methods provide any guarantees or is it assumed that a human reviews the output to verify that it was properly anonymized?

The very best case for Amnesia: veneer of GDPR compliance, maybe survive an audit.

Clients are buying plausible deniability, hedging their liability.

"Yes, we regrettably leaked sensitive data. But we followed all the rules. What more could we possibly do?"

Re: Amnesia – High-Accuracy Data Anonymization

#7
post #2

Do these methods provide any guarantees or is it assumed that a human reviews the output to verify that it was properly anonymized?

The very best case for Amnesia: veneer of GDPR compliance, maybe survive an audit. Clients are buying plausible deniability, hedging their liability. "Yes, we regrettably leaked sensitive data. But we followed all the rules. What more could we possibly do?"

"Not save my data in illegal ways"

Edit: "Not save my data"

Re: Amnesia – High-Accuracy Data Anonymization

#8
post #7

Earlier quoted context omitted.

The very best case for Amnesia: veneer of GDPR compliance, maybe survive an audit. Clients are buying plausible deniability, hedging their liability. "Yes, we regrettably leaked sensitive data. But we followed all the rules. What more could we possibly do?"

"Not save my data in illegal ways" Edit: "Not save my data"

This product is for orgs sharing data.

Re: Amnesia – High-Accuracy Data Anonymization

#9
post #5

Fair warning: anonymization is a hard problem. It is never easy, and you'd be surprised how many bits can leak out of what you thought was properly anonymized data. If you are using data for test purposes please use generated data, not anonymized data. This has the additional advantage that there is no potential path for live data to end up on a developers machine. added in edit: And also realize that just using a se…

This.

Alternatively look for an open-licensed dataset if one exists in your domain (e.g. using https://fairsharing.org or, shameless plug, https://biokeanos.com). With generated data you always add some assumptions, with more 'wild' data you have a chance to discover edge cases earlier.

Post reply on HN