Live data from Hacker News

A popular self-driving car dataset is missing labels for hundreds of pedestrians

blog.roboflow.ai

41–50 of 202 posts

Re: A popular self-driving car dataset is missing labels for hundreds of pedestrians

#41
post #35

Earlier quoted context omitted.

People should learn not to go outside if they're not labelled.

> People should learn not to go outside if they're not labelled. I worry what will happen when this idea breeds with the "why worry about privacy if you've got nothing to hide?" fallacy.

Wouldn't it be nice if preserving your privacy simply meant not wearing your QR code?

Re: A popular self-driving car dataset is missing labels for hundreds of pedestrians

#42

Earlier quoted context omitted.

> This is really scary. No, it's not even remotely "really scary". No one is putting an actual self-driving car on the market using this specific data set. Disingenuous to pretend this is any indication of the data using by serious companies in the space or is represented of the impact a few mislabelled samples have on the ability of these systems & algorithms to generalize.

It's scary when you consider two other factors: First, the AI hype train. People think that calling something "Artificial Intelligence" implies that it is artificial, yes, but also, critically, that it is intelligent. Many enthusiastic people, and also many policymakers, don't fully realize the extent to which machine learning is constrained by both the quality and nature of its training data, and the capabilities of…

As long as self driving vehicles are small passanger vehicles, they are not able to kill more than a few people.

If you look at the Uber accident, killing 1 person severly harmed the company.

The only extremely harmful scenario that I can imagine in self driving is a bad remote mass software update (which is sadly possible even in an otherwise great company) causing lots of accidents at the same time in different vehicles.

Re: A popular self-driving car dataset is missing labels for hundreds of pedestrians

#43

Earlier quoted context omitted.

People should learn not to go outside if they're not labelled.

What a funny future it'd be, if we have to wear something distinctive (giant QR codes?) so we don't get killed outside. As a side effect it would make tracking us much easier...

[deleted]

Re: A popular self-driving car dataset is missing labels for hundreds of pedestrians

#44

Earlier quoted context omitted.

People should learn not to go outside if they're not labelled.

What a funny future it'd be, if we have to wear something distinctive (giant QR codes?) so we don't get killed outside. As a side effect it would make tracking us much easier...

IR reflective tape on outdoor clothing. Not the most outlandish idea. I hate it but I can see a future of it.

Re: A popular self-driving car dataset is missing labels for hundreds of pedestrians

#45

Earlier quoted context omitted.

It's scary when you consider two other factors: First, the AI hype train. People think that calling something "Artificial Intelligence" implies that it is artificial, yes, but also, critically, that it is intelligent. Many enthusiastic people, and also many policymakers, don't fully realize the extent to which machine learning is constrained by both the quality and nature of its training data, and the capabilities of…

I'm not sure what point you're trying to make, but it has nothing to do with some mislabeled examples. Every system using supervised training assets has labeling issues, and the world hasn't ended yet. Take a look at Google Translate. This is only "scary" if you're ignorant of the problem. The OP is selling something, and it's in their best interest to spread FUD to sell it.

Nobody gets killed by Google Translate etc. messing up, so no sweat, throw together something that works 99% or the time.

But for safety critical systems it's six nines reliability or GTFO.

Re: A popular self-driving car dataset is missing labels for hundreds of pedestrians

#46

Earlier quoted context omitted.

It does not make use aware of a new class of errors. Labeling issues is nothing new, but plenty of systems trained on them continue to work just fine. This is FUD.

Is there any statistical/mathematical tool to completely eradicate or greatly diminish the effects of bad labeling? Is there any reason - other than the combination of pure circumstance and gut feeling of the Data Scientist in charge of saying that it's good enough to deploy - that ~33% insanity in training doesn't become ~33% insanity in the system?

Maybe we could use deep learning? Oh, wait...

Re: A popular self-driving car dataset is missing labels for hundreds of pedestrians

#47
amplification of the old complex/neurosis - not only people don't notice me, now robots too!

  Cellophane
  Mister Cellophane
  Shoulda Been My Name
  Mister Cellophane
  'Cause You Can Look Right Through Me
  Walk Right By Me
  And Never Know I'm There...
https://www.youtube.com/watch?v=WKHzTtr_lNk

Re: A popular self-driving car dataset is missing labels for hundreds of pedestrians

#48
post #18

These are manually tagged stills, right? Not video? That's a data set for training CAPCHA breakers, not self-driving. You need to use video, where you get to see the same objects at different ranges. Recognition gets better as you get closer. Then track the recognized objects backwards to when they first appear, and try to recognize them at smaller sizes.

I'm tangential to the field, but not directly in it myself, and I tend to agree. The goal of these systems should be to "perceive" their environment, not just to "recognize" it.

Perception means understanding that just because a truck (that we recognized 3 frames ago) went behind a tree, doesn't mean it ceased being a truck. Furthermore, this knowledge should be used to refine the model, to say "hey I can still see the wheels, I know those wheels were attached to that truck a moment ago, therefore I still know where the truck is, even if I can't recognize it plainly as such right now".

Furthermore, even if it's completely out of view, it's still there, probably moving close to the same speed and track it was. And if its path intersects ours, we need to assume that it'll reappear at some point. And the longer it's out of view, the bigger are the errors on its estimated position, according to our knowledge of the acceleration and braking limits of trucks of that type.

I've never heard of anyone even working towards this sort of perception, much less having achieved it. And until we get there, these things are all toys. Dangerous, legally nebulous toys.

Re: A popular self-driving car dataset is missing labels for hundreds of pedestrians

#49

Earlier quoted context omitted.

I'm not sure what point you're trying to make, but it has nothing to do with some mislabeled examples. Every system using supervised training assets has labeling issues, and the world hasn't ended yet. Take a look at Google Translate. This is only "scary" if you're ignorant of the problem. The OP is selling something, and it's in their best interest to spread FUD to sell it.

Nobody gets killed by Google Translate etc. messing up, so no sweat, throw together something that works 99% or the time. But for safety critical systems it's six nines reliability or GTFO.

> Nobody gets killed by Google Translate etc. messing up, so no sweat

It's not so much that "nobody gets killed by Google translate messing up" as "when people get killed by Google Translate messing up, I can't tell".

Re: A popular self-driving car dataset is missing labels for hundreds of pedestrians

#50

Earlier quoted context omitted.

People should learn not to go outside if they're not labelled.

What a funny future it'd be, if we have to wear something distinctive (giant QR codes?) so we don't get killed outside. As a side effect it would make tracking us much easier...

It would be less inconvenient than what I already have to do to avoid being killed by human drivers. Getting to the other side of a street according to regulation procedure can easily require taking a 10 minute detour. It can be worse than that in the suburbs.
Post reply on HN