Live data from Hacker News

AI Incident Database

incidentdatabase.ai

51–60 of 115 posts

Re: AI Incident Database

#51
post #9

Bit of a stretch to label an organisations shitty website security an AI incident just because it's a portal to the AI chatbot. I guess aviation disasters should now include passengers privacy incidents from hacked booking websites?

It's a bit hard to take any of the aggregate stats seriously when they bucket anything from "AI made a mistake and killed someone" to "AI-Generated-Text-Detection Tools Reported for High Error Rates" into the same "incident count".

Re: AI Incident Database

#52
post #9

Bit of a stretch to label an organisations shitty website security an AI incident just because it's a portal to the AI chatbot. I guess aviation disasters should now include passengers privacy incidents from hacked booking websites?

I see what you mean but… think of a conventional security issue around an AI like you would a chemical spill. Even though the failure may have been something boring like a bad seal, we could still call it a “hazardous chemical incident” or such.

But the chemical in this analogy is the AI.

AI didn't get accidentally or wrongfully or damagingly applied to anyone. The thing that leaked was not AI.

So it's like having hazardous chemicals around, but the bad seal wasn't on a container that had hazardous chemicals in it.

Re: AI Incident Database

#53
This is interesting, but the presence of so many incidents that ultimately have nothing to do with AI is disappointing.

Consider this incident:

https://incidentdatabase.ai/cite/73/#r1325

>Description: Through a crowdsourcing social media campaign in 2016, several journalists and researchers demonstrated that augmented reality locations in the popular smartphone game Pokemon Go were more likely to be in white neighborhoods.

>Alleged: Niantic Labs developed and deployed an AI system, which harmed non-white neighborhoods and communities of color.

Crowd-sourcing is not "AI". And the linked articles are things like Nintendo redesigning the pokemon Jynx to not look so much like a racial charicature.

It's hard to see the value of this sort of database if the indexed items are so unreliable. How can I trust any conclusions I might draw unless I go through item-by-item to verify them?

Re: AI Incident Database

#54

Earlier quoted context omitted.

Yeah, this site needs a clear definition of what is an AI upfront. Good luck with that.

Their minimum standard for inclusion appears to be any collection of if-statements.

This is the same standard for any Startup claiming to leverage AI, so I think that's fair

Re: AI Incident Database

#55
post #9

Bit of a stretch to label an organisations shitty website security an AI incident just because it's a portal to the AI chatbot. I guess aviation disasters should now include passengers privacy incidents from hacked booking websites?

(I am from the org behind the Incident Database) I agree about it being a stretch, but we err towards indexing boundary cases. This one turns on whether you would consider the web application as being part of ChatGPT or not. In aviation, there are many systems that are part of safely flying from point to point that are not part of the plane itself. The control tower, the runway markings, and the processes built aroun…

It's fine to consider the web app code as part of "ChatGPT".

But you shouldn't say that and also say "ChatGPT is an AI" at the same time. Those are two slightly but importantly different definitions of "ChatGPT".

Looking at your glossary here, the definition of "AI incident" should probably be adjusted, and in its current form it should not be taken too literally. Because if a server fell over on someone, and that server was hosting an AI, that would technically fit your definition.

Re: AI Incident Database

#56

Earlier quoted context omitted.

Genetically Modified Organisms? I was under the impression these were very safe. Can you change my mind?

Sorry for the subtle sarcasm, they are safe and that's exactly my point. 20 years ago everyone was scared of GMOs and begging for regulation. Many european nations banned them in response. Other places insisted on labeling them so consumers could avoid the danger. We now know that they are safe and these efforts were counterproductive.

There are more than two outcomes from AI. It's not either it kills us all or everything is perfect. It is a question of how much harm wi be caused, even if the harm is massively outweighed by the benefits.

Re: AI Incident Database

#58
post #33
post #5

Do we do things like this for other technology or for other software? Why the huge intense fear as soon as someone puts a label 'AI' on a piece of software?

Yes, we do. It’s AI accelerationists that are the ones demanding special treatment of being able to deploy potentially dangerous technology without any regulations and without doing any work to verify and demonstrate it is safe.

Is that really special treatment ? There was no NTSB before the first train derailed and killed people. We usually wait for a new technology to kill a lot of people before we address questions of safety.

Re: AI Incident Database

#59
post #53

This is interesting, but the presence of so many incidents that ultimately have nothing to do with AI is disappointing. Consider this incident: https://incidentdatabase.ai/cite/73/#r1325 >Description: Through a crowdsourcing social media campaign in 2016, several journalists and researchers demonstrated that augmented reality locations in the popular smartphone game Pokemon Go were more likely to be in white neighbor…

Based on that quote it sounds like the crowdsourcing was used to analyse the locations in order to show the bias. The claim is that AI was used to determine the locations on the first place.

If I recall rightly the Pokémon Go locations were derived in part from an earlier (and far better) game called Ingress. Players could submit candidate locations, but it's possible that this was mostly ignored, and/or some form of AI was used to select or filter those candidates. It's also possible that Ingress had a racial bias in its userbase.

Post reply on HN