Live data from Hacker News

Tech firms must tame toxic algorithms to protect children online

ofcom.org.uk

101–110 of 123 posts

Re: Tech firms must tame toxic algorithms to protect children online

#101
post #47

Earlier quoted context omitted.

Already happening in the EU. Give your phone number, credit card number, or government ID number if you want to watch age-gated YouTube. The best solution would be a government or banking API that emits a one-time token. No logging, and it self-destructs upon verification. But aside from the user, no other party has detriment from the current situation.

That's a really interesting idea. I was just wondering how any of this could be prevented in a way that preserves user choice.

While there's some complexity in the details of how you'd implement the protocol and avoid replay "attacks", there are potentially ways to use Chaumian blind signatures so that an age verifying authority can (blindly) sign a token you present after verifying your age (through some means that likely won't be anonymous), in an unlinkable way

As an overly simple thought experiment, you could generate a random ed25519 ephemeral public key, hash it, then send it (blinded, and thus unreadable) to an age verification service (with some long term age verification credential or similar).

The age verification provider does a blind signature on your (blinded) public key hash, and sends it back to you. You un-blind that signature (meaning that provider can't identify which identifiable request led to it, but now it bears the hash of your public key), and you can now authenticate to a service by signing a challenge with your ephemeral ed25519 private key.

The service only knows your ephemeral public key, and that it has been "vouched" (signed) by the age verification provider.

The age verification provider knows "you" asked for a token , but doesn't know what public key you used.

Clearly there are challenges with replaying (authorised user could share the private key every day with a group of others), and revocation of a credential whose private key gets shared among a group is hard (beyond providers blocking a public key).

The risk is that this becomes a race towards "DRM" and platform attestation/authentication to try and prevent private keys being exported.

Re: Tech firms must tame toxic algorithms to protect children online

#102
post #101

Earlier quoted context omitted.

That's a really interesting idea. I was just wondering how any of this could be prevented in a way that preserves user choice.

While there's some complexity in the details of how you'd implement the protocol and avoid replay "attacks", there are potentially ways to use Chaumian blind signatures so that an age verifying authority can (blindly) sign a token you present after verifying your age (through some means that likely won't be anonymous), in an unlinkable way As an overly simple thought experiment, you could generate a random ed25519 ep…

Maybe someone could chime in (cryptography is not my strong mathematical field), but isn't the entire point of ZK proofs(which are the hot buzzword in crypto) that you should be able to be verify certain information (i.e that you are of a certain age) without leaking any other information(which is similar to what you are proposing)?

Surely this is a better application of that rather than proposing another L2 to scale Ethereum?

Re: Tech firms must tame toxic algorithms to protect children online

#103
post #101

Earlier quoted context omitted.

While there's some complexity in the details of how you'd implement the protocol and avoid replay "attacks", there are potentially ways to use Chaumian blind signatures so that an age verifying authority can (blindly) sign a token you present after verifying your age (through some means that likely won't be anonymous), in an unlinkable way As an overly simple thought experiment, you could generate a random ed25519 ep…

Maybe someone could chime in (cryptography is not my strong mathematical field), but isn't the entire point of ZK proofs(which are the hot buzzword in crypto) that you should be able to be verify certain information (i.e that you are of a certain age) without leaking any other information(which is similar to what you are proposing)? Surely this is a better application of that rather than proposing another L2 to scale…

Good question.

By my understanding , in principle yes you could use ZK proofs - you can imagine it as a way to prove a certain assertion (age >= 18) in a way that isn't directly linked to other data. You sometimes see this in conceptual ID card specifications - using keys on a smart card to give a signed attestation about a single attribute without sharing other ones.

Ultimately though, when you need to actually implement it, you'll end up needing the same core concept as the thought experiment above - you'll need one or more "trusted central authorities" whose word is trusted on a given asserted attribute (age, etc).

They'll need a way to prove that they vouched for a user (as there's no digital way to validate their age as that's an unverifiable claim). You'll then need a way for the "bearer" of a ZK proof to tie themselves to that trusted central authority's attestation, and you'll need a way to prevent the information needed to generate that ZK proof being shared with others for replay.

A ZK proof will still need that external trusted authority for an attribute like age, because age isn't something you can root some kind of cryptographic trust from.

I'm not an expert in the ZK crypto either, but it doesn't deliver a magical ability to prove a (biological analog world claim) without chaining back to a trusted verifier of said claim, and effectively delivering that sort of "thought experiment" protocol.

Sometimes though, the complex solutions tend towards the simple - you could issue people "age verification" smart cards (if you have enough confidence in CC EAL6 or similar cards, and their side channel resistance) which are "group keyed" with common attestation signing keys for every million (or another suitable anonymity threshold) users, and share the public keys used (to allow verification you haven't been given a special unique public key), and then allow signed card-issued anonymous attestations. That would work for as long as you can keep the smartcard-backed key secure against side channel/ key extraction attacks.

The user adoption challenge in all this is getting users onboard and demonstrating it's a private solution rather than an excuse to oversee their online activities more, but I do believe you could do this in a manner that's going to make it easier to just identify them from IP address and adtech trackers or similar external means.

Re: Tech firms must tame toxic algorithms to protect children online

#104
post #44

Earlier quoted context omitted.

Adults could potentially protect themselves, children absolutely can't.

Children have legal guardians, who are responsible for their safety. If the adult an protect themselves, they can protect the children they're responsible for too

The adult is vulnerable as hell but children are an order of magnitude more vulnerable. Consider an adult with ADHD who can't stop themselves from these traps and consider a child with the same condition, possibly the child of a parent with ADHD. The adult is at least aware something is wrong, for the child there's no baseline and the patters are ingrained deeper.

Re: Tech firms must tame toxic algorithms to protect children online

#105
post #16
post #12

Earlier quoted context omitted.

As an adult, I do not want to be "protected". I can decide for myself if I like the algorithm or product/service and choose not to use it if I don't like it.

The problem is in modern societies the society is footing the bill for those who choose, let's say, unwisely. Why should my mandatory social and medical insurance taxes go fix issues created by such wrong choices? Should the society not cover them? E.g. smokers with lung cancer should pay out of pocket? Or should society try to minimize wrongdoing instead?

> is in modern societies the society is footing the bill

This isn't exactly true.... All societies always have footed the bill, modern or not. If you cast the person out in a middle age society then expect to get robbed by bandits on your next visit to the town next door.

Which emphasizes why you should attempt to minimize wrongdoing before it gets expensive, when you don't it turns into that story of "there was an old lady who swallowed a fly"

Re: Tech firms must tame toxic algorithms to protect children online

#106
post #10

Earlier quoted context omitted.

Adults could potentially protect themselves, children absolutely can't.

When facing off against an army of ML engineers and psychologists? It is obvious that even adults are suffering negative consequences from social media, and if it isn't obvious, take a look at any of the studies showing the negative impact on adults of social media usage. Every single consumer is outmatched. The only winning choice is to not play at all.

[deleted]

Re: Tech firms must tame toxic algorithms to protect children online

#107
post #10

Earlier quoted context omitted.

Adults could potentially protect themselves, children absolutely can't.

When facing off against an army of ML engineers and psychologists? It is obvious that even adults are suffering negative consequences from social media, and if it isn't obvious, take a look at any of the studies showing the negative impact on adults of social media usage. Every single consumer is outmatched. The only winning choice is to not play at all.

[deleted]

Re: Tech firms must tame toxic algorithms to protect children online

#108
post #10

Earlier quoted context omitted.

Adults could potentially protect themselves, children absolutely can't.

When facing off against an army of ML engineers and psychologists? It is obvious that even adults are suffering negative consequences from social media, and if it isn't obvious, take a look at any of the studies showing the negative impact on adults of social media usage. Every single consumer is outmatched. The only winning choice is to not play at all.

While I 100% agree with these statements, I still think children should take priority and are more vulnerable than the vulnerable adults. Eventually this whole dark pattern enterprise should be stopped. I see it spread its tentacles towards children and children who are compromise so early in their development may be damaged too much to be able to have a full recovery.

Re: Tech firms must tame toxic algorithms to protect children online

#109

Earlier quoted context omitted.

We all wish for an ideal future and, heavens know, it is a good thing that I am not an emperor for a day as a lot would change. Personally, and I mean it in a nice way, I am not obligated to build you a home. I am not even obligated to do it for my kid. Frankly, neither is the society as a whole. You want your elders build you a home for you. No deal. Best I can do is help you along by pulling you away from your cell…

I've always sort of felt that the whole "society is little removed from anarchy and no one owes anyone anything" is not all that far removed from "I can hit you on the head with a hammer and take your stuff if I feel like it".

Re: the hammer

Many people (myself included) think this is the true nature and shape of the world. There are lots of layers, institutions, and policy built on top, but what matters is ultimately who holds the hammer and what do they want.

This isn't as cynical as it might sound. Most people ultimately hold some real-world power, and have organized into systems that help them get what they want. Anger a human enough and they will withhold work, anger them more and they will resort to violence. This is the basis of all society.

Re: Tech firms must tame toxic algorithms to protect children online

#110

Earlier quoted context omitted.

We all wish for an ideal future and, heavens know, it is a good thing that I am not an emperor for a day as a lot would change. Personally, and I mean it in a nice way, I am not obligated to build you a home. I am not even obligated to do it for my kid. Frankly, neither is the society as a whole. You want your elders build you a home for you. No deal. Best I can do is help you along by pulling you away from your cell…

> Personally, and I mean it in a nice way, I am not obligated to build you a home. I am not even obligated to do it for my kid. Frankly, neither is the society as a whole. I'll happily pay many multiples of what homes used to cost - just make it legal to build homes. Let us do the things we want without having to cut through a thicket of laws intended to help and protect us. We don't want them. Please, we've had more…

I love your attitude. I hope you know that there are tons of people in older generations who also agree with removing nanny regulations.
Post reply on HN