Live data from Hacker News

Dutch scandal serves as a warning for Europe over risks of using algorithms

politico.eu

181–190 of 197 posts

Re: Dutch scandal serves as a warning for Europe over risks of using algorithms

#181
post #2

This scandal and the issues at the dutch tax office runs much deeper than just this one set of issues, they also maintained illegal lists of 'potential fraudulent people' on which 100's of thousands of people that had done nothing wrong, such as having the 'wrong' surname. It's rotten to the core and to date there have been zero consequences for the perps and the damage continues to pile up. Our government has fallen…

D66 who I would argue was the true winner of the election does not consist of "exact same players". The next election, given that we don't have the new pandemic or war in Europe, will be the last one for Rutte, I believe.

D66 also wasn't the major problem here, that was clearly the VVD.

As for the last of Rutte, I thought that we had seen that one election before the last and yet he's still there.

Re: Dutch scandal serves as a warning for Europe over risks of using algorithms

#182

Earlier quoted context omitted.

Yes, and besides it is the one government institution fining another, so there is really no consequence for any of this.

It kills me when government institutions get fined as a punishment. It's just the tax payers that are being punished. We as a society need to do better to incentivize good behavior for those in trusted government positions, and hold the individuals responsible when they betray that trust.

Yes!!! Exactly and precisely this. The actual individuals should be accountable for decisions they made that ruined other peoples lives for wrongful cause.

Too often political decisions have been predicated on the notion of cost-free bullying of lower status humans to serve as grist for the mills of polemical political opposition and discourse, to feed careers. The bullfighter needs a bull and ideally it should look scary before the predetermined outcome of slaying the scapegoat takes place.

While corporations and governments only punish the people with unilateral action of malice or ignorance, one can never truly punish an institution, one seeks individuals who are responsible in the hopes of reducing the willingness of individuals to commit such acts given the possibility of individual punishment.

Nothing says impunity like impunity.

Fining the institution does nothing to discourage career hit-and-ruin experts who keep climbing the career ladder upon the backs of others.

Re: Dutch scandal serves as a warning for Europe over risks of using algorithms

#184
post #17
post #2

This scandal and the issues at the dutch tax office runs much deeper than just this one set of issues, they also maintained illegal lists of 'potential fraudulent people' on which 100's of thousands of people that had done nothing wrong, such as having the 'wrong' surname. It's rotten to the core and to date there have been zero consequences for the perps and the damage continues to pile up. Our government has fallen…

It's shocking to read, and reminds me of the British Post Office scandal. A €3.7 million + €2.75 million fines are a slap-on-the wrist for what happened. Even €30,000/case seems a pittance compared to its effects on people. It mentions there were "secret blacklists of people for two decades" and that "authorities [were] hiding information or misleading the parliament about the facts". I don't see how regulating algor…

> I don't see how regulating algorithms and AI could affect those institutional injustices.

Because this is a dangerous technology which has only proven, again and again, to be unreliable, unethical, inaccurate, and is EASILY used by the people most likely to abuse it.

The point is not that the dutch tax office is corrupt, it is that corrupt individuals and entities are likely, and have used, this for nefarious, foul purposes. Regulating and/or banning its use is only one of many avenues to attempt to safeguard (against) this tech.

Re: Dutch scandal serves as a warning for Europe over risks of using algorithms

#185

Earlier quoted context omitted.

On the other hand one of the main triggers for this whole operation was the mass fraud by people from Bulgaria who netted a lot of benefits by gaming the system. They traveled to the Netherlands, applied for benefits and then went back to Bulgaria and used Dutch bank accounts and debit cards to get the cash. The tax office never wanted that to happen again and started this program to find fraudsters but ended up clas…

Ironically, this is one of the reasons I like the idea of UBI - you can't defraud the government when they're giving money to everyone. Most of the budget required to detect and enforce fraud vanishes. Secondary effects (and their costs), such as the one presented in this story, go away. It's not that simple, I know. But spending so much on bureaucratic red tape and fraud prevention is something that feels really sil…

[deleted]

Re: Dutch scandal serves as a warning for Europe over risks of using algorithms

#186
Sounds a bit like Australia's illegal Robodebt scheme:

https://en.wikipedia.org/wiki/Robodebt_scheme

The Australian system was simpler than the Dutch system, comparing social benefits paid with averaged tax-income from the ATO. It was a stupidly wrong calculation, the averaged income is much higher in people with inconsistent income than it actually is, so people were hounded by debt collectors for nonexisting debt. A$1.2 billion false debt for a nation of 25 million people. A good number of associated suicides.

Of course, there was no real accountability, with the system having been introduced by the previous government who is now in opposition. Money has been paid back but everybody involved still has their job.

Re: Dutch scandal serves as a warning for Europe over risks of using algorithms

#187
post #17

Earlier quoted context omitted.

It's shocking to read, and reminds me of the British Post Office scandal. A €3.7 million + €2.75 million fines are a slap-on-the wrist for what happened. Even €30,000/case seems a pittance compared to its effects on people. It mentions there were "secret blacklists of people for two decades" and that "authorities [were] hiding information or misleading the parliament about the facts". I don't see how regulating algor…

> I don't see how regulating algorithms and AI could affect those institutional injustices. Because this is a dangerous technology which has only proven, again and again, to be unreliable, unethical, inaccurate, and is EASILY used by the people most likely to abuse it. The point is not that the dutch tax office is corrupt, it is that corrupt individuals and entities are likely, and have used, this for nefarious, foul…

In my reading, people aren't saying the tax office corrupt, but rather that it was illegally discriminatory. Eg:

> the Dutch data protection agency also fined the Dutch tax administration €2.75 million in December 2021 for the “unlawful, discriminatory and therefore improper manner”

My point is that AI regulation is insufficient, not that it's unnecessary. Eg, the Amnesty International report says:

> civil servants spoke in denigrating terms about families with Caribbean roots, referring to them as an “Antillean nest”. Civil servants flagged these applicants through manual selection.

Manual selection is independent of AI.

Re: Dutch scandal serves as a warning for Europe over risks of using algorithms

#188

Earlier quoted context omitted.

You're right, it's no different: both are corruption.

Can you prove how it's corruption?

You're right, it's proven beyond doubt that it's corruption

Re: Dutch scandal serves as a warning for Europe over risks of using algorithms

#189
post #133

Earlier quoted context omitted.

On the other hand one of the main triggers for this whole operation was the mass fraud by people from Bulgaria who netted a lot of benefits by gaming the system. They traveled to the Netherlands, applied for benefits and then went back to Bulgaria and used Dutch bank accounts and debit cards to get the cash. The tax office never wanted that to happen again and started this program to find fraudsters but ended up clas…

Perhaps the problem is setting the wrong incentives. The way to deter fraud is not necessarily to make the benefits administration overly strict but to directly dis-incetivize fraud through stiff penalties. For instace if benefits fraud had a penalty of say 10 to 20 years imprisonment if convicted, the number of people trying to commit fraud would very likely go dramatically down.

What is "fraud"? People have gotten in to trouble for accepting groceries from family members and not reporting it to the benefit office as additional (in-kind) income. Technically, it is fraud, too, so they're not wrong.

There's a long list of examples of "fraud"; like many crimes it's a scale.

Re: Dutch scandal serves as a warning for Europe over risks of using algorithms

#190

Earlier quoted context omitted.

It kills me when government institutions get fined as a punishment. It's just the tax payers that are being punished. We as a society need to do better to incentivize good behavior for those in trusted government positions, and hold the individuals responsible when they betray that trust.

Yes!!! Exactly and precisely this. The actual individuals should be accountable for decisions they made that ruined other peoples lives for wrongful cause. Too often political decisions have been predicated on the notion of cost-free bullying of lower status humans to serve as grist for the mills of polemical political opposition and discourse, to feed careers. The bullfighter needs a bull and ideally it should look…

They don't even lose their jobs. 'Just following orders'...
Post reply on HN