Live data from Hacker News

Amnesia – High-Accuracy Data Anonymization

amnesia.openaire.eu

61–70 of 99 posts

Re: Amnesia – High-Accuracy Data Anonymization

#61
post #54

Insensitive name to people actually suffering from amnesia, (me).

I am sorry, but I disagree.

You disagree only because you don't suffer from this condition. You can't truly know how offensive it is without being the person who suffers from the condition.

Does a white person truly know about how offensive it is to call an African American the n-word? No. He/She won't without becoming African American himself. It's the same story here.

Re: Amnesia – High-Accuracy Data Anonymization

#62
post #5

Fair warning: anonymization is a hard problem. It is never easy, and you'd be surprised how many bits can leak out of what you thought was properly anonymized data. If you are using data for test purposes please use generated data, not anonymized data. This has the additional advantage that there is no potential path for live data to end up on a developers machine. added in edit: And also realize that just using a se…

Hah! Came here to echo what you wrote. I’ve been in (too) many data anonymizing/sanitizing efforts. It’s nothing but easy. I would strongly consider investing in test data generation.

Re: Amnesia – High-Accuracy Data Anonymization

#63
post #52

Earlier quoted context omitted.

https://en.wikipedia.org/wiki/K-anonymity#Methods_for_k-anon...

k-anonymity is often only applied to "pseudoidentifiers", if you have the original dataset it'd be trivial to reverse k-anonymity applied that way. For example someone's blood pressure isn't considered an identifying variable, and would not need to be anonymised (should not too, to keep data utility high), however this would make linking against the original dataset trivial.

You are right, time series data like BPM over time does not lend itself to anonymization nicely, the provider most likely will have to ask the user organizations what kind of measures (features) they need and return an average (if that's what the receiving organisation was after) that itself can be k-anonymized.

Re: Amnesia – High-Accuracy Data Anonymization

#65
post #56
post #40

Earlier quoted context omitted.

Also with synthetic data, there is an inherent trade-off between privacy risks and the usefulness of the data produced. However, this trade-off can be of a different nature, resulting in advantages for synthetization, for example when protecting high-dimensional data.

Are there good ways to measure the amount (original) subject level data that can be extracted from a synthetic dataset, or calculated risk of reidentification (which is nice and easy for k-anonymity (if your assumptions are valid))?

Risk of re-identification is hard to estimate. It's mostly because you have to assume some state of background knowledge. I.e. what fields does the adversary even know something about.

If Im looking for a white male in new york city it's going to be harder to find my target than it would be if I also know their birth date and zip code.

Re: Amnesia – High-Accuracy Data Anonymization

#67
post #59

Earlier quoted context omitted.

> Data anonymized with Amnesia are statistically guaranteed that they cannot be linked to the original data. It looks like (from other text on their site) they use variants on k-anonymity. This can prevent re-linking attacks back to the original data, but we've also known for a decade that this isn't especially strong. For example, two independent k-anonymous releases can unique identify everyone in the dataset[0]. […

However that statistical guarantee also requires your pseudoidentifiers to be picked correctly, i.e. it only holds true if you select all variables the attacker could possibly know about a subject. I think that is the hard part here, it's not something I would recommend someone doing without a lot of research and experience for highly dimensional data.

Right. Even if you assume the worst-case-scenario there isn't some standard risk metric nor threshold to meet.

I feel like differential privacy is the strongest definition we have, but it is also lacking from a practical standpoint. What does it mean to have N nats/bits of information gain from seeing the result of a query? How does this translate to my risk of a PII leak?

Re: Amnesia – High-Accuracy Data Anonymization

#68
post #47

Earlier quoted context omitted.

If someone makes inferences on the de-identified data, or joins it against another dataset. The source dataset lets those inferences or joins be tied back to the original identifying data. The main point is that de-identified data can still be "personal" so it's regulated. If you share or make public psuedonymous data, that data is still covered by GDPR so you have to inform the individuals, have a legal basis (such…

> The source dataset lets those inferences or joins be tied back to the original identifying data. But if the attacker lacks the source dataset, they can't do this, and if they possess the source dataset, they'd use it for their analysis rather than using the anonymised dataset.

The point is that if the attacker can connect your user record in the source data with user # 188da24a7789d in the "anonymized" data, they can use that de-identify all information derived or built on the "anonymized" data.

Oh, there is Netflix account for user # 188da24a7789d and the IRS released tax summaries for user # 188da24a7789d? That's interesting, since I know that user # 188da24a7789d is really MaxBarraclough.

Post reply on HN